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SECTION  X 


INTRODUCTION 

1.  BACKGROUND 

As  is  the  care  with  any  newly  developing  technological  area, 
image  processing  has  tended  to  evolve  in  an  ad  hoc  manner.  There 
has  been  little  or  no  effort  at  standardization  of  definitions, 
structural  notation,  algorithm  specification,  terminology  and 
methodology.  An  important  first  step  in  the  direction  of 
standardization  is  the  development  of  a  uniform  underlying 
mathematical  structure  for  the  expression  of  image  processing 
algorithms . 

If  one  surveys  the  literature,  he  at  once  recognizes  the 
disparate  manner  in  which  algorithms  are  specified.  It  is 
extremely  difficult  to  recognize  procedures  which  are  essentially 
the  same  but  are  being  presented  by  two  different  authors. 
Moreover,  the  lack  of  any  underlying  set  of  fundamental  image 
processing  operations  (at  a  low  level)  makes  optimization  and  the 
reduction  of  complexity  essentially  impossible.  It  is  as  if  one 
attempts  to  proceed  through  algebra  and  calculus  without  any 
understanding  of  the  basic  operations  of  arithmetic  and  the  laws 
pertaining  to  these  operations. 

Because  of  the  present  chaotic  state  of  image  processing 
algorithm  specification,  the  need  for  a  study  of  the  underlying 
mathematical  operations  is  apparent.  The  problem  is  threefold: 

a.  The  criteria  that  an  underlying  set  of  operations  must 

satisfy  must  be  delineated. 

b.  A  suitable  fundamental  collection  of  low  level  operators 
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must  be  found. 


c.  The  mathematical  structure  of  the  algebra  based  upon  the 
fundamental  operators  must  be  investigated  and  the  entire 
structure  must  be  placed  within  the  appropriate  mathematical 
framework.  It  is  the  intent  of  the  current  effort  to 
accomplish  the  aforementioned  tasks. 


2.  THE  PROJECT 


This  report  represents  the  culmination  of  approximately  one 
year's  effort  to  find  an  imaging  algebra.  Though  much 
developmental  work  remains  to  be  done,  the  skeleton  of  a 
satisfactory  structure  appears  to  have  been  found.  It  is  the 
intent  of  this  report  to  define,  explain,  illustrate  and 
demonstrate  the  capabilities  of  the  proposed  algebraic  structure. 

Several  germane  attributes  of  the  proposed  structure 

are: 

a.  mathematical  and  computer  implementation  of  the 
basis 

b.  range  and  domain  induced  basic  operators 

c.  basic  projection  operators 

d.  spanning  capability  of  the  basis 

e.  image  macro  operators 

f.  ordered  basic  and  macro  operators  by  complexity. 


The  attributes  represent,  in  compact  form,  those  properties 
that  were  identified  in  the  project  as  being  critical  to  the 
eventual  success  of  the  system. 


SECTION  IX 


FUNDAMENTAL  OPERATORS  IN  THE  IMAGE  ALGEBRA 


1.  BASIS 

A  set  of  criteria  that  a  collection  of  elemental  operations 
should  satisfy  in  order  to  qualify  as  a  candidate  for  a  basis 
that  will  underlie  the  development  of  an  image  processing  algebra 
has  been  articulated.  The  primary  role  of  a  basis  is  to  serve  as 
a  construct  to  categorize  thinking  at  a  certain  level.  Once  such 
a  categorization  is  given,  uniformity  of  structure  results.  The 
ability  to  communicate  is  enhanced  and  the  development  of 
linguistic  models  is  made  possible.  Moreover,  there  is  no  loss 
of  freedom,  since,  as  the  category  of  thinking  gets  broader,  the 
existing  definition  of  the  basis  can  be  concomitantly  broadened 
to  accommodate  the  novel  concepts.  Should  a  particular  field 
encompass  several  seemingly  disjoint  transformation  types,  as 
dees  image  processing,  a  level  approach  to  basis  construction  can 
be  taken.  Each  level  may  have  its  own  mini-basis  and  the  basis 
of  the  entire  collection  of  operations  may  be  taken  as  a  union  of 
the  individual  mini-bases.  In  terms  of  an  image  processing 
algebra,  there  are  various  levels  to  be  considered.  Therefore, 
it  is  appropriate  to  take  a  modular  approach. 

Essentially,  there  are  several  criteria  the  overall  basis 
should  satisfy.  It  should  be  representable.  Important  image 
operations  should  be  definable  under  function  composition  using 
the  elemental  operations  of  the  basis.  This  is  the  so-called 
spanning  capability  of  the  basis.  Those  algorithms  for  which 
there  exists  a  basis  representation  will  be  part  of  the  resulting 
system.  If  the  basis  is  to  have  good  spanning  characteristics, 
these  representable  algorithms  must  form  a  class  which  contains 
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the  vast  majority  of  the  existing  procedures. 


The  addition  of  new  and  important  operations  might  require 
an  expansion  of  the  basis. 

A  second  criterion  the  basis  should  satisfy  is  that  of 
manipulability .  It  should  be  convenient  to  use  in  that  high  level 
functions  and  macro-functions  are  for  the  most  part  readily 
obtainable  from  the  basis  elements.  It  should  be  modular  and 
also  provide  views  at  various  levels.  There  should  also  be  a 
general  simplicity  so  that  the  underlying  operations  are  easily 
visualized  and  understood. 

Next,  the  basis  should  be  efficient.  The  desire  is  for 
elementary  operations,  though  not  necessarily  the  most 
elementary.  The  overall  basis  should  be  space-time  efficient  and 
thereby  provide  a  pragmatically  functional  system.  It  should 
support  a  collection  of  macro-operators  from  which  the  varied 
imaging  operations  can  be  expressed.  Although  the  basic 
operators  may  not  be  independent  of  one  another  in  a  strict 
mathematical  sense,  needless  redundancy  must  be  avoided.  In  a 
sense,  this  last  criterion  embodies  the  essential  thinking  of  the 
Image  Processing  Language  Program:  The  ultimate  goal  is  not  a 
system  which  is  minimal  from  a  strictly  logical  perspective,  but 
one  that  provides  a  structured  framework  for  the  practical 
expression  of  useful  algorithms . 


2.  IMAGE  ALGEBRA  CRITERIA 

A  set  of  criteria  that  a  mathematical  structure  should 
satisfy  in  order  to  qualify  as  a  candidate  for  an  image 
processing  algebra  has  been  ascertained.  From  a  rigorously 
logical  point  of  view,  the  image  algebra  itself  is  mainly 
determined  by  the  choice  of  basis.  Nevertheless,  it  is  useful  to 
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specifically  articulate  those  properties  which  are  desirable  for 
the  algebraic  system  as  a  whole.  The  image  algebra  must  satisfy 
certain  heuristic  conditions  in  order  to  serve  as  the  supporting 
structure  for  image  processing.  There  are,  in  fact,  many 
different  bases  which  lead  to  the  same  algebra.  Therefore,  while 
there  is  interplay  between  the  basic  criteria  and  the  algebraic 
criteria,  they  are  to  some  e:-:tent  exclusive.  As  a  result,  the 
desirable  properties  for  an  imaging  algebra  need  to  be  treated 
separately . 


The  algebra  must  be  effective  and  efficient.  It  is 
effective  to  the  extent  that  it  enables  autonomous  target 
detection  and  classification  algorithms  to  be  represented  and 
developed. 

Necessary  to  a  pratical  effectiveness  is  simplicity  and 
clarity;  the  algebra  must  be  accessible  to  those  who  desire  to 
use  it.  Its  efficiency  depends  upon  the  extent  to  which  it 
allows  for  algorithms  to  be  developed  in  a  favorable  fashion  with 
respect  to  cost  and  resources.  It  must  allow  for  the  ready 
exploitation  of  the  parallelism  which  is  inherent  in  so  many 
imaging  algorithms. 

The  algebra  should  unify  many  typed  criteria.  It  should 
serve  as  a  vehicle  for  bringing  together  the  many  diverse  areas 
of  image  processing  through  the  utilization  of  precise 
specifications . 

The  imaging  algebra  should  be  at  once  expandable  and  robust. 
Expandability  requires  that  there  be  a  capability  to  delete, 
insert  or  modify  operators.  Robustness  requires  that  the  schema 
should  have  little  or  no  variation  with  changes  in  operators, 
types  or  constraints.  Moreover,  the  formalism  must  be  adaptive 
to  changes  due  to  advances  in  mathematics,  in  the  characteristics 
of  imaging  sensors  and  in  the  architecture  of  processors  and 
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memory  elements. 


The  imaging  algebra  structure  should  support  object  oriented 
design.  This  requires  it  to  be  programmably  transportable.  It 
should  be  an  easy  task  to  go  from  operators  in  the  algeora  into 
code  for  most  machines.  The  framework  should  also  support  a 
disciplined  programming  style  with  various  levels  of  abstraction. 
It  should  lead  to  brevity,  clarity,  modularity  and  concinnity. 

Certainly  all  of  the  preceding  conditions  cannot  be 
satisfied  in  their  entirety.  Nonetheless,  they  can  serve  as 
guidelines  to  which  the  construction  of  a  useful  and 
comprehensive  imaging  algebra  might  aspire. 


3.  THE  ELEMENTAL  OPERATORS 

The  most  essential  property  of  any  set  of  fundamental 
operators,  or  basis,  in  an  imaging  algebra  is  its  spanning 
capability,  that  is,  the  ability  to  serve  as  a  set  of  elemental 
operations  from  which  image  processing  algorithms  can  be 
constructed.  Without  a  good  spanning  capacity,  a  basis,  and  hen_e 
the  resulting  imaging  algebra,  would  fall  short,  no  matter  how 
excellent  its  other  characteristics.  The  proposed  basis  has  the 
desired  spanning  capability  while  at  the  same  time  being  composed 
of  operations  which  are  both  simple  and  natural. 

In  order  to  appreciate  the  power  and  simplicity  of  the 
proposed  basis,  it  is  important  to  recognize  that  the 
construction  of  a  satisfactory  imaging  algebra  requires  at  the 
outset  the  exposure  of  the  structures  that  underlie  the 
operational  specification  of  image  processing  algorithms.  As 
wich  most  mathematics,  these  primitive  structures  tend  to  be 
quite  simple.  In  general,  the  end  prodxict  of  mathematical 
reasoning  can  be  elaborate  and  difficult  for  the  non-expert  to 
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penetrate;  however,  the  premises  from  which  the  reasoning  begins 
are  usually  not  overly  complex.  In  the  case  of  the  proposed 
imaging  algebra,  its  structure  must  allow  for  the  development  of 
post  current  and  (hopefully)  future  imaging  transformations. 

These  may  ultimately  prove  to  be  of  a  high  order  of 
complexity;  nevertheless,  they  must  spring  from  some  low  level  of 
primitives.  These,  in  turn,  will  be  a  by-product  of  the 
supporting  mathematical  structures  upon  which  the  operations  are 
based. 


While  the  preceding  remarks  tend  to  be  philosophical  in 
nature,  once  the  structural  particulars  of  imaging  algorithms  are 
discovered,  they  lead  directly  to  the  proposed  basis.  A  digital 
image  defined  herein  is  a  partial  function  on  ZxZ  into  the  reals, 
that  is,  it  is  a  function  whose  domain  is  a  subset  of  Z>:Z  and 
whose  codomain  is  the  real  number  system  R.  The  domain  is  the  extent  and 
codomain  is  the  grey-scale  of  an  image.  The  set  of  all  images  will  be 
denoted  by  X.  It  is  mathematically  natural  to  look  within  the  structures  of 
ZxZ  and  R  to  find  the  primitive  operations  of  image  processing.  Both  ZxZ  and 
R  are  extremely  rich  and  well-studied  mathematical  entities.  Each  ha3  an 
extensive  structure  from  which  to  draw.  The  proposed  basis  was  developed  by 
drawing  upon  those  domain  (ZxZ)  and  codomain  (R)  structural  properties  which 
play  a  role  in  digital  image  procesing.  As  occurs  through  mathematics,  these 
lead  at  once  to  corresponding  properties  (or,  in  this  case,  operations) 
within  the  new  structure  which  they  together  induce.  Therefore,  there 
naturally  arises  a  set  of  domain  induced  (from  ZxZ)  operations  and  a  set  of 
codomain  induced  (from  R)  operations.  In  a  sense,  one  might  say  that  these 
are  there  to  be  found.  For  a  succesful  image  algebra,  one  needs  to  select 
those  operations  which  are  required  for  the  convenient  representation  of 
digital  imaging  transformations. 


It  must:  be  understood  that  while  the  preceding  comments 

provide  a  natural  approach  to  the  basis  selection  problem,  they 
do  not  provide  a  deterministic  methodology.  Pragmatic  modelling 
decisions  must  be  made.  Not  only  does  one  have  to  search  the 
literature  to  see  what  is  going  on,  one  must  recognize  that 
different  images  can  have  different  domains  within  Z:-:Z.  The 
decision  as  to  how  to  proceed  when,  for  example,  one  desires  to 
add  two  images  with  different  domains  must  be  made  in  a  heuristic 
manner.  In  making  such  decisions  for  the  proposed  basis,  an 
attempt  has  been  made  to  define  the  elemental  operations  in  a  way 
which  reflects  the  manner  in  which  the  induced  operations  are 
most  used  in  practice.  Fortunately,  it  turns  out  that  in  every 
instar. ce  that  has  come  to  attention,  other  natural  choices  for 
the  induced  elemental  operations  are  derivable  as  terms  in  the 
algebra  or  as  Macro-Operators  from  the  chosen  basis  set.  These 
macro-operators  are  given  in  a  later  section  along  with  a 
rigorous  discussion  of  the  inducement  process. 

TABLE  1.  FUNDAMENTAL  OPERATORS  IN  IMAGE  ALGEBRA 


I 

Addition 

© 

II 

Multiplication 

© 

III 

Maximum 

© 

IV 

Division 

© 

V 

Translation 

T 

VI 

Rotation 

N 

VII 

Reflection 

D 

VIII 

Domain  Extractor 

K 

IX 

Parameter  Extractor 

G 

X 

Existential  Operator 

E 

4.  SPECIFICATION  OF  OPERATORS 

The  first  four  fundamental  operators  to  be  introduced  are 
range  induced,  and  they  include  addition,  multiplication,  maximum 
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and  division.  The  next  three  operations  are  translation, 
rotation,  and  reflection.  They  also  take  digital  images  into 
digital  images;  however,  they  are  domain  induced.  The  final 
three  operations  in  the  basis  do  not  take  images  into  images. 
They  include  the  domain  extraction  operation,  which  takes  an 
image  and  returns  a  subset  of  ZxZ,  the  parameter  extraction 
operation,  which  maps  an  image  into  the  reals,  and  the 
existential  operation,  which  is  used  in  creating  an  image. 

An  image  is  a  real-valued  mapping  defined  on  a  subset  of  the 
integral  lattice  ZxZ.  Symbolically,  an  image  is  a  mapping 
f:  A— »R,  where  A  c  ZxZ.  We  also  employ  the  customary  notation  ra 

for  the  class  of  all  such  mappings,  f  from  A  into  R.  Note  that  fcr  the  null 
set  0  c  Z:-:Z,  we  obtain  the  so-called  null  image.  It  has  an  empty  domain. 
As  for  the  collection  of  sill  images,  we  denote  this  class  by  X  and 

X  -  RA 

ACZxZ 

Insofar  as  a  particular  grey  value  of  an  image  f  e  RA  is 
concerned,  this  is  denoted  by  f(i,j),  where  (i,j)  e  A  c  ZxZ.  The 
first  element  of  the  pair,  i,  gives  the  position  on  the  x-axis, 
while  the  second,  j,  gives  the  position  on  the  y-axis . 

a.  Addition  (Range  Induced).  Since  each  pixel  in  the 

domain  of  an  image  has  a  grey  value  which  is  an  element  of  R,  the 
real  number  system,  and  since  there  is  a  natural  addition  (+)  in 
R,  there  is  an  induced  addition  defined  as  a  binary  operation  on 
images.  This  image  addition  is  denoted  by  (+)  and  is  a  basis 
operation.  For  each  pixel  in  the  intersection  of  the  input 
domains,  the  output  image  has  the  arithmetic  sum  of  the  input 
grey  values  at  that  pixel.  For  a  pixel  which  lies  in  one  of  the 
input  domains  but  not  both,  the  decision  has  been  made  to  leave 
its  grey  value  unchanged.  A  similar  decision  has  been  made 
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regarding  the  mu  .tiplication  operator  and  the  maximum  operator, 
each  of  which  will  be  considered  in  turn.  We  define 
+)  :  X  ::  X  — >  X  as  follows: 

If  the  domain  of  f  is  A  and  the  domain  of  g  is  B,  then  the 
domain  of  f  ©  g  is  A  U  B  and 


(f©g)  » 


f  (:-:,y) 

“  g(K,y) 

If  y )  +  g(::,y) 


(x,y)  €  A  -  B 

y )  6  B  -  A 

(>:,y)  €  A  n  B 


b.  Multiplication  (Rang*  Inducad).  Similar  reasoning  as 
given  in  the  addition  operation  is  applied  to  the  natural 
multiplication  (•)  in  R.  The  result  is  a  pixelwise  induced 
multiplication  operation  on  pairs  of  input  images.  For  a  pixel 
in  the  intersection  of  the  domains  of  the  input  images,  the 
corresponding  grey  values  are  multiplied.  On  the  other  hand,  the 
grey  value  of  a  pixel  which  lies  in  only  one  domain  of  the  input 
images  is  left  unchanged. 


Hence  we  define  the  binary  operator 


©  :X  x  X  — »  X,  where  the  operands  are  images  and  the  output 
is  also  an  image,  as  follows: 


Let  the  domain  of  f  be  A  and  the  domain  of  g  be  B.  Then  the 
domain  of  f  ©  g  is  A  U  B  and 


( f  ©  g )  ( x ,  y )  = 


<x,y> 

jgO^y) 

If  (x,  y)  '  g  ( x ,  y ) 


(x,y)  e  A  -  B 

y)  6  B  -  A 

(x,y)  e  A  n  B 


c.  Maximum  (Range  Induced).  Given  two  real  numbers  in  R 
there  is  a  natural  order  operation  called  maximum.  Simply 
stated,  for  two  real  numbers  y  and  z,  y  v  z  is  either  y,  z  or 
their  common  value,  depending  respectively  upon  whether  y  is 
greater,  z  is  greater  or  they  are  equal.  This  naturally  induces 
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a  pixelwise  maximum  on  the  intersection  of  two  input  domains. 
Once  again,  the  heuristic  determination  has  been  made  to  leave 
the  input  images  unaltered  off  the  intersection.  The  operation 
is  denoted  by  ©  . 

We  define  ©  :  X  x  X  — »  X,  where  the  domain  of  f 
is  A  and  the  domain  of  g  is  B,  then  the  domain  of 

f  ©  g  is  A  U  B  and 


_  ff(:-:,y)  (:-:,y)  €  A  -  B 

(f  ©  g)  (**’/ Y)  =  ]  g  (k,  y)  (:-:,y)  €  B  -  A 

If  (x,y)  v  g  (x,  y)  (>:,y)  €  A  n  B 


d.  Division  (Range  Induced).  Each  grey  value  z  which  is 
not  zero  has  a  reciprocal  grey  value  1/z.  Hence  there  is  a 
natural  image  operation,  called  division,  which  replaces  each 
nonzero  grey  value  by  its  reciprocal.  It  is  denoted  by 
+) .  Since  in  R  the  reciprocal  of  zero  is  undefined,  it  has 
been  decided  that  the  division  operation  should  leave  the  output 
image  undefined  at  any  pixel  for  which  the  input  image  has  grey 
value  zero. 


Consequently,  ©  :  X  — »  X,  where  if  there  is  a  zero  pixel  in 
the  input  image  then  the  output  image  has  a  smaller  domain  than 
the  input . 

Specifically,  (  ©  f )  (x,y)  =  l/f(>:,y)  if  f(x,y)  0  and  is 

undefined  if  f(x,y)  =  0.  When  the  division  is  preceded  by  a 

multiplication  operator©,  we  shall  omit©. 

a.  Translation  (Domain  Induced).  Given  a  position  vector 
in  a  two  dimensional  space,  denoted  by  (m,n),  the  vector  addition 
between  (m,n)  and  another  vector  (i,j)  yields  a  new  position 
vector  (m+i,n+j).  Geometrically,  the  original  position  is  moved 
over  (x  direction)  i  units  to  the  right  and  up  (y  direction)  j 
units.  This  position  operation  induced  the  translation  operation 
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on  images.  The  elemental  operator  T  moves  an  image  over  and  up, 
while  leaving  grey  values  unchanged.  Notationally,  T(f,i,j)  or 
^  is  used  to  indicate  the  image  obtained  by  moving  it  over 
units  and  up  j  units.  It  is  this  domain  induced  operator  T  which 
has  proved  to  be  invaluable  in  the  exploitation  of  the  natural 
parallelism  which  exists  in  many  imaging  operations.  We  define 

T:  XxZxZ  -a  X,  where  T  is  the  trinary  operator  defined  by: 

(T  ( f ,  i ,  j )  )  ( x , y )  -  f(x-i,y-j) 

£.  Ninety  Degree  Rotation  (Domain  Induced).  A  set  of 

ordered  pairs  in  the  two  dimensional  lattice  ZxZ  can  be  rotated 
9C°  in  the  counter-clockwise  direction.  This  at  once  induces  a 
90°  rotation  operation  N.  The  grey  values  of  the  input  images 
are  left  unchanged  and  the  image  is  simply  rotated. 
Consequently:  N  :  X  — >  X  is  (N(£))  (x,y)  -  f(y,-x). 

g.  Diagonal  Raflaction  (Domain  Inducad).  This  operation 

is  similar  in  origin  to  the  90°  rotation,  except  that  the  image 
is  flipped  out  of  the  page  around  a  135°  line  through  the  origin. 
This  operation  is  denoted  by  D.  D  :  X  — ►  X,  by  (D (f ) )  (x,y)  = 

f  (-y  Hence  D  makes  row  pixels  become  column  pixels  (and 

conversely)  by  rotating  the  image  180°  out  of  the  page  about  the 
-45°  axis. 

h.  Domain  Extractor.  The  domain  of  an  image  is  a  subset 
of  ZxZ.  It  is  natural  and  convenient  to  consider  the  operation  K 
which  takes  an  image  and  yields  a  subset  of  ZxZ,  that  subset 
being  the  domain  of  the  image.  Hence  K  :  X  — »  2ZxZ,  and  for  f  in 
R\  A  C  ZxZ,  K ( f )  -  A. 

i.  Parameter  Extractor.  Each  pixel  in  the  domain  of  an 
image  has  a  given  grey  value.  It  is  often  necessary  to  read  out 
that  value,  which  is  an  element  of  R,  the  codomain.  It  turns  out 


that  it  is  only  necessary  to  assume  the  ability  to  extract  the 
grey  value  at  the  origin  pixel.  Others  can  be  found  first 
applying  the  appropriate  translations.  This  basis  operation 
yields  the  grey  value  at  the  origin  pixel  for  a  given  input 
image.  The  complexity  of  the  rigorous  definition  results  from  the 
desire  to  have  this  operator  defined  even  if  the  grey  value  at 
the  origin  is  undefined.  In  that  event,  the  closest  grey  value 
is  chosen.  This  latter  stipulation  is  essentially  just  a 
mathematical  formality  since  it  is  possible  to  move  any  grey 
value  to  the  origin  by  translation.  The  operator  G  extracts  the 
grey  value  of  the  pixel  which  is  closest  to  the  origin  in 
Euclidean  distance  and  at  the  smallest  angle  from  the  abscissa. 


Hence  G:  X  — >  R,  where 


G(f) 


f(0,0)  when  f  e  RA  and  (0,0)  e  A 
'  0  when  f  *  0 

.f(i,j)  otherwise,  where  tan*1(j/i) 
is  minimized  for  minimum 
i2  +  j2. 


j.  Existential  Operator.  Somewhat  opposite  of  the  domain 
finding  operation  and  parameter  extraction  operation  is  the 
Existential  Operation  E.  This  operator  is  a  binary  operator  used 
in  manufacturing  an  image.  The  inputs  of  this  operator  are  a 

grey  valu-^  t  and  a  subset  A  of  Z::Z .  The  output  is  a  constant 

image  with  domain  A  such  that  every  pixel  in  A  has  grey  value  t. 
Such  an  image  is  denoted  by  tA  ;  5.e.,  tA(i,j)  -  t  if  (i,j)  <=  A 

and  is  undefined  otherwise.  Thus  ws  define  E  :  R  x  2Zxl— >X  where 

t  e  R  and  A  e  22xZ  ,  E(t,A)  -  tA  .  The  aforementioned 
operations  form  the  proposed  basis.  Each  taken  singularly  is 
very  simple  in  its  structure.  Yet  taken  as  a  collection,  they 
possess  a  powerful  spanning  capability  insofar  as  the  following 
transformation  types  are  concerned:  image  to  image,  image  to 

parameter,  and  image  to  set.  Both  their  simplicity  and  their 
power  result  from  the  inducement  methodology  which  brings  them  to 
light . 
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SECTION  Ill 


CONCLUSION 

This  report  represents  the  culmination  of  approximately 
one  year's  effort  to  find  an  imaging  algebra.  Though  much 
developmental  work  remains,  the  skeleton  of  a  satisfactory 
structure  appears  to  have  been  found.  An  algebraic  structure 
in  the  form  of  a  many  sorted  algebra  has  been  presented  to 
describe  operations  used  in  image  processing.  This  system 
involves  ten  fundamental  operations.  The  germane  attributes 
of  this  structure  follow: 

a.  The  ten  underlying  basic  operators  are  elemental 
from  the  perspectives  of  both  mathematics  and  machine 
implementation . 

b.  Seven  of  the  basic  operators  are  either  range  induced, 

or  domain  induced,  thereby,  rendering  them  both  operationally 
and  structurally  familiar. 

c.  Two  of  the  operators  are  projections,  one  extracting 
the  domain  of  an  image  and  the  other  allowing  the  extract¬ 
ion  of  the  range.  The  tenth  operator,  the  existential 
operator,  allows  the  formation  of  an  image.  These  three 
operators  provide  for  extensive  data  structure  manipulation 
and  for  easy  movement  among  the  sorts  within  the  image 
algebra. 

d.  An  already  well-developed  collection  of  image  algorithm 
oriented-  macro-operators  has  been  developed.  Structural 


evaluation  of  these  macros  is  in  progress.  The  macros 
provide  a  workable  vehicle  for  the  transposition  of  existing 
image  processing  algorithms  into  the  algebra. 

e.  The  spanning  capability  of  the  proposed  basis  is 
extensive;  indeed,  not  one  strictly  digital  algorithm  has 
yet  been  presented  which  is  not  expressable  in  terms  of  the 
basic  ten  operators. 

f.  By  telescoping  the  basic  operators  and  the  macros, 
arranged  in  some  sort  of  order  of  increasing  complexity,  it 
should  be  possible  to  develop  an  image  processing  language 
in  which  the  user  has  access  at  all  levels  down  to  the  basic 
set  of  ten.  The  resulting  language  will  make  full 
availability  of  the  inherent  parallelism  within  imaging 
algorithms . 

The  preceding  attributes  of  the  algebra  represent,  in 
compact  form,  those  properties  that  were  identified  early  in  the 
project  as  being  critical  to  the  eventual  success  of  the  system. 
As  a  consequence,  we  believe  the  project  has,  to  this  date, 
attained  or  surpassed  all  of  its  original  goals. 


16 


APPENDIX  A 


PHASE  I  ACTIVITIES 


17/18  (Blank) 


APPENDIX  A 


PHASE  I  ACTIVITIES 

1.  CONSOLIDATION/CLASSIFICATION/DESCRIPTION 

A  list  has  been  compiled  of  existing  image  processing 
transforms/  image  measurement  techniques  and  feature  vector 
analysis  techniques.  An  attempt  has  been  made  to  include 
numerous  methods  occurring  in  the  current  literature  and  in  every 
known  text  on  image  processing.  The  names  of  over  a  hundred  of 
the  operators  in  this  listing  appear  in  Appendix  D  of  this 
document . 

The  transforms,  measurement  techniques  and  feature  vector 
analysis  techniques  in  the  aforementioned  list  have  been 
classified  according  to  the  nature  of  their  functions. 

Categories  in  the  classification  schema  include  image 
enhancement,  edge  detection,  statistical  measurement,  feature 
vector  analysis,  segmentation,  image  coding,  image  compression, 
clustering,  data  structure  labeling,  image  reconstruction,  noise 
reduction,  image  texture  modeling,  thinning,  decomposition 
techniques,  classification,  geometric  parametrization,  grey  level 
distribution,  filtering/smoothing,  normalization,  geometric  esti¬ 
mation,  connectivity  criteria,  size  and  shape  description  and 
digitalization. 


A  brief  characterization  of  each  transform,  measurement 
tec..  ;,  and  feature  vector  analysis  technique  has  been 
prepared.  The  characterization  includes  a  description  of  the 
operator's  effectiveness  as  well  as  its  deficiencies.  Where 
alternative  versions  or  equivalent  transforms  exist,  each  version 
has  been  identified,  often  along  with  specific  advantaqes  and 
disadvantages . 
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2.  IDENTIFICATION/DEFINITION  OF  ELEMENTAL  OPERATIONS 

Common  elemental  operations  composing  the  collected 
transforms  and  measurement  techniques  have  been  investigated  and 
identified,  or  defined. 

Collections  of  elemental  operations  that  might  serve  as  a 
bases  to  generate  the  image  processing  transforms  and  measurement 
technques  described  above  have  been  identified.  A  description  of 
useful  elemental  operations  will  be  provided  below. 


3.  IDENTIFICATION/DESCRIPTION/EVALOATION  or  MATHEMATICAL  STRUCTURES 

A  set  of  criteria  that  a  collection  of  elemental  operations 
should  satisfy  in  order  to  qualify  as  a  candidate  for  a  basis 
that  will  underly  the  development  of  an  image  processing  algebra 
has  been  articulated.  The  primary  role  of  a  basis  is  to  serve  as 
a  construct  to  categorize  thinking  at  a  certain  level.  Once  such 
a  categorization  is  given,  uniformity  of  structure  results.  The 
ability  to  communicate  is  enhanced  and  the  development  of 
linguistic  models  is  made  possible.  Moreover,  there  is  no  loss 
of  freedom,  since,  as  the  category  of  thinking  gets  broader,  the 
existing  definition  of  the  basis  can  be  concomitantly  broadened 
to  accomodate  the  novel  concepts.  Should  a  particular  field 
encompass  several  seemingly  disjoint  transformation  types,  as 
does  image  processing,  a  level  approach  to  basis  construction  can 
be  taken.  Each  level  may  have  its  own  mini-basis  and  the  basis 
of  the  entire  collection  of  operations  may  be  taken  as  a  union  of 
the  individual  mini-bases.  In  terms  of  an  image  processing 
algebra,  there  are  various  levels  to  be  considered.  Therefore, 
it  is  appropriate  to  take  a  modular  approach. 
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Essentially  there  are  several  criteria  the  overall  basis 
should  satisfy.  First  it  should  be  representable.  Important 
image  operations  should  be  definable  under  function  composition 
using  the  elemental  operations  of  the  basis.  This  is  the 
so-called  spanning  capability  of  the  basis.  Those  algorithms  for 
which  there  exists  a  basic  representation  will  be  a  part  of  the 
resulting  system-  If  the  basis  is  to  have  good  spanning 
characteristics,  these  representable  algorithms  must  form  a  class 
which  contains  the  vast  majority  of  the  existing  procedures.  The 
addition  of  new  and  important  operations  might  require  an 
expansion  of  the  basis. 

A  second  criterion  the  basis  should  satisfy  is  that  of 
manipulability .  It  should  be  convenient  to  use  in  that  high  level 
functions  and  macro-functions  are  for  the  most  part  readily 
obtainable  from  the  basis  elements.  It  should  be  modular  and 
also  provide  views  at  various  levels.  There  should  also  be  a 
general  simplicity  so  that  the  underlying  operations  are  easily 
visualized  and  understood. 

Next,  the  basis  should  be  efficient.  The  desire  is  for 
elementary  operations,  though  not  necessarily  the  most 

elementary.  The  overall  basis  should  be  space-time  efficient  and 
thereby  provide  a  pragmatically  functional  system.  It  should 
support  a  collection  of  macro-operators  from  which  the  varied 
imaging  operations  can  be  expressed.  Although  the  basic 

operators  may  not  be  independent  of  one  another  in  a  strict 
mathematical  sense,  this  last  criterion  embodies  the  essential 
thinking  of  the  Image  Processing  Language  Program:  the  ultimate 
goal  is  not  a  system  which  is  minimal  from  a  strictly  logical 
perspective,  but  one  that  provides  a  structured  framework  for  the 
practical  expression  of  useful  algorithms. 

While  the  preceding  criteria  tend  to  be  heuristic  in  nature, 
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the  last  criterion  to  be  discussed,  consistency,  is  a  fundamental 
logical  requirement.  It  must  be  impossible  to  deduce  a 
proposition  and  its  negation  utilizing  the  basis  elements.  While 
on  the  surface  the  consistency  condition  is  readily 
understandable,  the  rigorous  verification  of  such  a  statement  can 
be  most  difficult;  indeed,  the  notion  of  consistency  goes  to  the 
most  profound  depths  of  the  foundations  of  mathematics.  In  this 
instance,  it  will  suffice  to  note  that  the  existence  of  a  real 
world  model  can  be  taken  as  proof  of  consistency  since  it  is  a 
fundamental  postulate  of  science  that  two  contradictory 
propositions  concerning  the  real  world  cannot  be  simultaneously 
maintained.  In  the  case  of  the  imaging  algebra  there  is  no 
problem  relating  to  consistency,  since  all  of  the  basis  operators 
are  induced  from  either  the  algebraic  structure  of  the  grid  or 
the  arithmetic  structure  of  the  real  line. 

A  set  of  criteria  that  a  mathematical  structure  should 
satisfy  in  order  to  qualify  as  a  candidate  for  an  image 
processing  algebra  has  been  ascertained.  From  a  rigorously 
logical  point  of  view,  the  image  algebra  itself  is  mainly 
determined  by  the  choice  of  basis.  Nevertheless,  it  is  useful  to 
specifically  articulate  those  properties  which  are  desirable  for 
the  algebraic  system  as  a  whole.  The  image  algebra  must  satisfy 
certain  heuristic  conditions  in  order  to  serve  as  the  supporting 
structure  for  image  processing.  There  are,  in  fact,  many 
different  bases  which  lead  to  the  same  algebra.  Therefore,  while 
there  is  interplay  between  the  basis  criteria  and  the  algebra 
criteria,  they  are  to  some  extent  exclusive.  As  a  result,  the 
desirable  properties  for  an  imaging  algebra  need  to  be  treated 
separately . 

The  algebra  must  be  effective  and  efficient.  It  is 
effective  to  the  extent  that  it  enables  autonomous  target 
detection  and  classification  algorithms  to  be  represented  and 
developed.  Necessary  to  a  practical  effectiveness  is  simplicity 
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and  clarity;  the  algebra  must  be  accessible  to  those  who  desire 
to  use  it.  Its  efficiency  depends  upon  the  extent  to  which  it 
allows  for  algorithms  to  be  developed  in  a  favorable  fashion  with 
respect  to  cost  and  resources.  It  must  allow  for  the  ready 
exploitation  of  the  parallelism  which  is  inherent  in  so  many 
imaging  algorithms. 

The  algebra  should  unify  many  typed  criteria.  It  should 
serve  as  a  vehicle  for  bringing  together  the  many  diverse  areas 
of  image  processing  through  the  utilisation  of  precise 
specifications . 

The  imaging  algebra  should  be  at  once  expandable  and  robust . 
Expandability  requires  that  there  will  be  a  capability  to  delete, 
insert,  or  modify  operators.  Robustness  requires  that  the  schema 
should  have  little  or  no  variation  with  changes  in  operators, 
types,  or  constraints.  Moreover,  the  formalism  must  be  adaptive 
to  changes  due  to  advances  in  mathematics,  in  the  characteristics 
of  imaging  sensors  and  in  the  architecture  of  processors  and 
memory  elements. 

The  imaging  algebra  structure  should  support  object  oriented 
design.  This  requires  it  to  be  programmably  transportable.  It 
should  be  an  easy  task  to  go  from  operators  in  the  algebra  into 
code  for  most  machines .  The  framework  should  also  support  a 
disciplined  programming  style  with  various  levels  of  abstraction. 
It  should  lead  to  brevity,  clarity,  modularity,  and  concinnity. 

Certainly  all  of  the  preceding  conditions  cannot  be 
satisfied  in  their  entirety.  Nonetheless,  they  can  serve  as 
guidelines  to  which  the  construction  of  a  useful  and 
comprehensive  imaging  algebra  might  aspire. 

It  was  recognized  that  any  structure  which  encompasses  the 
previously  mentioned  elemental  operations  must  be  many  typed.  It 


could  be  a  many  sorted  relational  structure  or  a  many  sorted 
partial  algebra.  The  overall  choice  in  this  direction  was  a  many 
sorted  algebra.  Many  sorted  "Igebras  are  discussed  in  Appendix 
C. 


Yet  the  issue  cannot  be  left  at  this  level.  Many  well-known 
mathematical  structu'  fit  the  requirements  of  a  many-sorted 
algebra.  Such  a  struc,  re  is  quite  general. 

But  the  particular  entity  arising  from  a  choice  of  basis  is 
most  specific.  Indeed,  it  is  here  that  the  approach  taken 
becomes  crucial. 

To  put  the  matter  succinctly,  an  image  is  a  function  whose 
domain  is  a  subset  of  the  collection  of  integral  lattice  points 
in  the  plane  and  whose  range  is  the  real  numbers.  Therefore,  in 
looking  for  a  basis,  it  is  natural  to  examine  closely  the 
structure  of  the  .lattice  points,  ZxZ,  and  the  real  number  line, 
R.  Inherent  operations  within  those  mathematical  structures 
induce,  or  lead  to,  corresponding  operations  on  images.  These 
so-called  induced  operations  arise  naturally  and  therefore  must 
be  investigated.  The  choice  as  to  which  ones  are  ultimately 
chosen  for  the  imaging  algebra  is  not  a  mathematical  question, 
but  a  heuristic  one.  It  requires  an  exhaustive  examination  of 
those  operations  which  are  utilized  in  image  processing. 
Essentially  the  point  is  this:  there  is  no  need  to  look  for 
exotic  operations;  there  is  only  a  need  to  take  enough  of  the 
natural  operations  to  accomplish  the  specification  of  current 
i  - ge  processing  algorithms. 

The  preceding  approach  served  as  a  catalyst  yielding  the 
list  of  elemental  operations . 

Two  questions  arise  at  once.  First,  why  not  include  more 
induced  operations?  To  this  one  can  only  answer  that  they  are  not 
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needed  at  the  present  time.  Those  which  can  be  derived  from  the 
ones  chosen  are  already  there.  Others,  which  might  have  been 
included,  appear  to  have  no  place  in  actual  image  processing  as 
it  exists  today.  By  utilizing  induced  operations,  the  basis  is 
ipso  facto  expandable.  If  there  should  arise  a  need  for  more 
induced  operators,  then  simply  include  them.  Since  they  will  be 
induced,  they  will  be  consistent  with  the  already  existing 
structure.  This  point  is  paramount  for  the  development  of  an 
image  processing  language:  the  language  can  be  augmented  without 
unduly  disturbing  its  current  structure. 

The  other  question  which  comes  immediately  to  mind  is  this: 
Why  not  include  non-induced  operations?  In  other  words,  why  not 
bring  in  operations  which  do  not  conform  in  a  natural  mannner  to 
the  underlying  lattice  structure  and  the  underlying  real  number 
structure?  Here  the  answer  is  quite  straightforward.  Not  only 
have  no  such  operations  been  discovered  in  the  literature 
search,  but  it  is  not  likely  that  such  operations  would  be  of 
much  practical  value.  If  an  imaging  language  is  to  be  useful  as 
a  means  of  communication  and  specification,  it  cannot  be  burdened 
with  bizarre  operations  which  do  not  conform  to  the  usual 
arithmetic  notions  held  by  users.  Moreover,  it  is  not  likely 
that  bizarre  operations  would  be  utilized  in  algorithm 
development  to  begin  with. 

From  a  practical  point  of  view,  the  imaging  algebra  as 
conceived  by  the  contractor  is  a  mathematical  structure  in  Its 
own  right.  Just  as  the  term  vector  algebra  denotes  a  particular 
algebra,  which  happens  to  be  many  sorted,  it  is  likely  that  the 
term  image  algebra  will  someday  come  to  denote  a  particular 
algebra,  the  one  which  arises  naturally  from  the  underlying 
mathematical  structure  and  the  pragmatics  of  image  processing. 

A  description  and  demonstration  of  some  of  the  properties 
and  relationships  defining  each  mathematical  structure  identified 
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above  has  been  performed.  A  sample  of  these  properties  can  be 
found  in  Appendix  C. 

There  were  several  criteria  cited  above  concerning  desirable 
basis  properties.  The  proposed  basis  is  certainly  acceptable 
from  the  perspective  of  those  criteria.  It  is  manipulable;  the 
basis  elements  provide  accessible  tools  for  macro-function 
development.  It  is  sufficient;  the  basis  provides  a  structured 
and  straightforward  environment  for  algorithm  expression.  It  is 
representable;  the  basis  has  an  excellent  spanning  capability  for 
image  to  image  and  image  to  parameter  operations. 

In  so  far  as  the  criteria  described  are  concerned,  the 
proposed  algebra  (resulting  form  the  choice  of  basis)  possesses 
simplicity  and  clarity.  It  allows,  through  the  translation 
operator,  excellent  exploitation  of  parallelism.  Moreover,  its 
induced  nature  makes  it  both  expandable  and  robust.  Lastly,  the 
elemental  mathematical  level  of  the  basis  operators  will  result 
in  machine  transportability. 

The  proposed  basis  together  with  necessary  accompanying 
explanation  is  given  in  Appendix  C. 

An  initial  demonstration  of  the  capability  and  versatility 
of  the  optimal  mathematical  structure  has  been  completed. 
Appendix  gives  a  sample  of  some  image  processing  techniques  which 
have  been  translated  and  expressed  in  terms  of  the  optimal 
structure  identified  previously. 
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APPENDIX  B 


PHASE  II  PROPOSED  ACTIVITIES  FOR  SPONSOR'S 
REVIEW  AND  APPROVAL 

It  is  planned  to  extend  the  algebraic  and  other  pertinent 
mathematical  properties  and  relationships  of  the  optimal 
structure.  Basic  research  necessary  to  extend  the  mathematical 
properties  and  relationships  of  the  selected  basic  set  shall  be 
conducted.  This  research  will  extend  the  image  processing 
algebra's  properties  and  relationships  which  have  been  identified 
in  Appendix  A,  section  3. 

In  particular,  an  indepth  investigation  shall  Ke  made  into 
determining  the  various  equational  constraints,  such  as  the 
commutative  or  associative  laws,  satisfied  or  not  satisfied  by 
the  operators  in  the  algebra.  The  natural  induced  method  by 
which  the  operators  in  the  algebra  were  obtained  will  aid  in  this 
variety  specification.  This  information  will  be  useful  in  the 
determination  of  various  substructures  within  the  optimal 
structure.  Well  known  substructures  such  as  groups,  rings, 
lattices  and  so  on  shall  be  described  and  identified  along  with 
their  importance. 

Principle  operational  and  transformational  properties  and 
relationships  of  the  algebra  shall  be  identified  and  illustrated. 
This  shall  include  operational  and  transformational  optimization 
techniques . 

The  identification  of  equational  constraints  mentioned  above 
can  be  used  for  transformational  and  operational  optimization. 
Due  to  these  equational  constraints,  various  transforms, 
measurement  techniques,  or  feature  analysis  techniques  may  be 
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expressed  in  terms  of  the  basis  operators  in  several  different 
ways.  For  instance,  if  the  distributive  law  (of  multiplication  by 
reals  with  respect  to  image  addition)  holds,  then  there  would  be 
a  choice  of  using  one  add  and  one  multiply  or  one  add  and  two 
multiplies . 

The  optimization  criteria  would  be  utilized  in  determining 
the  best  representations  in  terms  of  the  basis.  Various 
criteria,  such  a  maximizing  concurrent  operators,  minimizing 
certain  types  of  operators,  etc.,  shall  be  investigated. 

Often  sub-optimal  solutions  may  be  obtained  involving  macro 
operations...  Various  image  processing  operations  are  often 
comprised  of  common  operators  not  belonging  to  the  basis.  These 
common  operations  are  expressible  in  terms  of  basis  operators  and 
are  termed  macro  operators.  Macro  operators  could  be  represented 
in  an  optimal  fashion  in  terms  of  basis  operators  as  described 
above.  In  turn,  image  processing  operations  could  be  expressed  in 
an  optimal  fashion  in  terms  of  these  macro  operations.  It  is 
possible  that  only  a  sub-optimal  representation  will  be  found  for 
the  image  operation.  In  other  words,  one  might  be  satisfied  with 
optimization  relative  to  the  higher  level  macro  operators  and 
forego  total  optimization  at  the  lowest  level.  In  any  case,  an 
extensive  investigation  is  planned  into  sub-optimal  representa¬ 
tions  utilizing  macro  operations. 

A  list  of  theorems  and  proofs  of  all  principal  properties 
and  relationships  implied  or  required  by  the  image  processing 
algebra  shall  be  prepared. 

A  summary  of  advantages  and  disadvantages  of  the  chosen 
structure,  together  with  a  list  of  unsettled  problems  concerning 
the  structure,  shall  be  prepared.  Imperative  additional  research 
or  development  shall  also  be  recommended. 
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A  document  which  reports  the  result  of  examining  the 
feasibility  of  augmenting  the  developed  image  processing  algebra 
by  artificial  intelligence  (AI)  techniques  shall  be  prepared.  If 
augmentation  is  determined  feasible,  included  in  the  report  will 
be  a  plan,  with  justifying  rationale,  for  the  integration  of 
artificial  intelligence  with  the  developed  image  processing 
algebra . 

Among  the  possible  ways  AI  could  be  integrated  into  and 
along  with  the  image  algebra  is  by  the  development  of  knowledge 
base  or  expert  systems.  These  systems  could  be  designed  to  aid 
image  processing  personnel  utilize  the  image  algebra.  They  would 
represent  a  type  of  smart  computer  assisted  instruction.  Here 
the  user  might  be  knowledgeable  in  what  imaging  techniques  to 
employ  when,  but  would  need  the  expert  system  to  aid  in  utilizing 
the  algebra  or  to  optimize  procedures  within  the  algebra. 

In  a  different  but  related  direction,  an  expert  system  could 
be  designed  which  incorporates  various  levels  of  the  algebra, 
e.g.,  basis  operation  and  various  macros.  The  system  will  be 
used  to  aid  in  the  development  of  image  processing  algorithms  for 
those  not  knowledgeable  in  algorithm  development. 

An  imaging  algorithm  is  a  finite  string  of  imaging 
operations.  Thus,  it  is  composed  of  a  longer  finite  string  of 
macros,  and  a  still  longer  string  of  basis  operators.  As  such,  a 
totally  automated  optimal  algorithm  development  is  indeed  a  goal. 
Here  a  brute  force  search  could  be  employed  combining  macro  or 
basis  operators  in  various  ways  to  determine  algorithms. 

However,  hueristics  and  subjective  judgments  should  be  employed 
in  guiding  this  search,  thus  saving  time.  Developed  algorithms 
should  be  played  against  simulated  data.  Subsequently, 

statistical  packages  should  be  employed  in  determining  the 
quality  of  each  algorithm. 


In  the  image  processing  algebra  developed  herein,  images 
were  defined  as  functions  from  subsets  of  the  lattice  points  in 
the  plane  into  the  reals;  that  is,  each  pixel  had  a  real  number 
attached  to  it  denoting  a  value  of  grey.  This  value  of  grey  is 
initially  obtained  from  a  sensor  and  the  accuracy  of  the  sensor 
is  sometimes  in  question.  A  more  realistic  modeling  of  the 
situation  might  be  to  use  a  range  of  reals  to  denote  the  grey 
value  at  a  given  pixel.  More  generally,  a  possibility 

distribution  might  be  employed  to  denote  values  of  grey  at  pixels 
or  at  larger  regions  of  images. 

Demonstration  of  techniques  for  using  the  developed  image 
processing  algebra  to  express/approximate,  analyze,  and  optimize 
the  performance  of  existing  image  processing  algorithms  will  be 
performed.  In  addition,  the  use  of  each  new  image  processing 
transform  technique  resulting  from  the  development  of  this  image 
processing  algebra  shall  be  demonstrated. 

A  document  entitled  Standard  Image  Processing  Algebra  shall 
be  prepared.  This  manuscript  shall  include  definitions  for  a 
collection  of  standardized  symbols  which  subsequently  will  be 
used  to  express  the  complete  mathematical  structure  of  the 
developed  image  processing  algebra.  There  will  also  be 
illustrations  demonstrating  the  application  and  versatility  of 
uhe  structure.  The  appropriate  justification  for  proposing  that 
the  developed  image  processing  algebra  should  serve  as  an  Air 
Force  standard  image  processing  algebra  shall  also  be  given.  A 
document  and  supporting  explanatory  vu-graphs  entitled  Standard 
Image  Processing  Algebra  in  a  Nutshell,  will  give  a  synopsis  of 
the  developed  standard  image  processing  algebra.  Furthermore, 
this  document  shall  be  suitable  for  publication  in  a  technical 
journal . 

At  the  completion  of  Phase  II,  the  imaging  algebra  will  be 
implemented  in  the  form  of  an  image  processing  language.  Among 
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the  problems  addressed  in  Phase  II  will  be  the  so-called  boundary 
value  problems.  These  involve  the  manner  in  which  the  algebra 

expressed  algorithms  will  handle  boundary  pixels  and  other 

special  cases.  Since  the  operators  of  the  proposed  basis  work  on 
subsets  of  ZxZ,  it  is  felt  that  these  boundary  value  problems 
will  not  require  the  introduction  of  new  operations;  rather,  they 
will  only  require  specially  adapted  subroutines  with  a  given 
algorithm. 

Another  language  related  issue  concerns  interaction  at  the 

terminal  level.  The  desire  is  for  software  that  allows  for  an 

algebra-operator  oriented  symbolism  at  •  the  keyboard.  Basis 

level,  and  perhaps  some  macro  level,  operations  should  be 
accessed  directly  by  single  keys.  Moreover,  the  characters  on 
these  keys  should  be  indicative  of  the  imaging  operation  to  be 
performed.  The  thinking  at  this  early  stage  is  towards  some  sort 
of  overlay  which  can  be  transported  to  various  machines. 

A  second  fundamental  consideration  is  for  AI  interaction  at 
the  keyboard.  The  expertise  gained  by  the  developers  of  the 
algebra  should  be  integrated  into  a  comprehensive  expert  system 
which  can  impart  direction  and  insight  to  users. 

A  time  schedule  of  Phase  II  activities  and  milestones  can  be 
found  in  Appendix  F. 
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APPENDIX  C 


TUTORIAL  ON  IMAGE  ALGEBRA 


1.  INTRODUCTION 

This  report  represents  the  culmination  of  approximately  one 
year's  effort  to  find  an  imaging  algebra.  Though  much 
developmental  work  remains  to  be  done,  the  skeleton  of  a 
satisfactory  structure  appears  to  h«.ve  been  found.  It  is  the 
intent  of  this  report  to  define,  explain,  illustrate  and 
demonstrate  the  capabilities  of  the  proposed  algebraic  structure. 

In  reading  this  report,  several  points  regarding  the  germane 
attributes  of  the  proposed  structure  should  be  kept  in  mind: 

a.  The  ten  underlying  basis  operators  are  elemental 
from  the  perspectives  of  both  mathematics  and  machine 
implementation . 

b.  Seven  of  the  basic  operators  are  either  range 
induced  or  domain  induced,  thereby  rendering  them  both 
operationally  and  structurally  familiar. 

c.  Two  of  the  operators  are  projections,  one 
extracting  the  domain  of  an  image  and  the  other  allowing  the 
extraction  of  the  range.  The  tenth  operator,  the 
existential  operator,  allows  the  formation  of  an  image. 
These  three  operators  provide  for  extensive  data  structure 
manipulation  and  for  easy  movement  among  the  sorts  within 
the  image  algebra. 

d.  An  already  well-developed  collection  of  image 
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algorithm  oriented  macro-operators  has  been  developed. 
Structural  evaluation  of  these  macros  is  in  progress.  The 
macros  provide  a  workable  vehicle  for  the  transposition  of 
existing  image  processing  algorithms  into  the  algebra. 

e.  The  spanning  capability  of  the  proposed  basis  is 
extensive;  indeed,  not  one  strictly  digital  algorithm  has 
yet  been  presented  which  is  not  expressable  in  terms  of  the 
basic  ten  operators. 

f.  By  telescoping  the  basic  operators  and  the  macros, 
arranged  in  some  sort  of  order  of  increasing  complexity,  it 
should  be  possible  to  develop  an  image  processing  language 
in  which  the  user  has  access  at  all  levels  down  to  the  basic 
set  of  ten.  The  resulting  language  will  take  full 
availability  of  the  inherent  parallelism  within  imaging 
algorithms . 

The  preceding  attributes  of  the  algebra  represent,  in 
compact  form,  those  properties  that  were  identified  early  in  the 
project  as  being  critical  to  the  eventual  success  of  the  system. 


2.  FUNDAMENTAL  OPERATORS  IN  THE  IMAGING  ALGEBRA 

The  most  essential  property  of  any  set  of  fundamental 
operators,  or  basis,  in  an  imaging  algebra  is  its  spanning 
capability,  that  is,  the  ability  to  serve  as  a  set  of  elemental 
operations  from  which  image  processing  algorithms  can  be 
constructed.  Without  a  good  spanning  capacity,  a  basis,  and  hence 
the  resulting  imaging  algebra,  would  fall  short,  no  matter  how 
excellent  its  other  characteristics.  The  basis  has  the  desired 
spanning  capability  while  at  the  same  time  being  composed  of 
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operations  which  are  both  simple  and  natural. 


In  order  to  appreciate  the  power  and  simplicity  of  the 
proposed  basis,  it  is  important  to  recognize  that  the 
construction  of  a  satisfactory  imaging  algebra  requires  at  the 
outset  the  exposure  of  the  structures  that  underlie  the 
operations  specification  of  image  processing  algorithms.  As  with 
most  mathematics,  these  primitive  structures  tend  to  be  quite 
simple.  In  general,  the  end  product  of  mathematical  reasoning  can 
be  elaborate  and  difficult  for  the  non-expert  to  penetrate; 
however,  the  premises  from  which  the  reasoning  begins  are  usually 
not  overly  complex .  In  the  case  of  the  proposed  imaging  algebra, 
its  structure  must  allow  for  the  development  of  most  current  and 
(hopefully)  future  imaging  transformations.  These  may  ultimately 
prove  to  be  of  a  high  order  of  complexity;  nevertheless,  they 
must  spring  from  some  low  level  set  of  primitives.  These,  in 
turn,  will  be  a  by-product  of  the  supporting  mathematical 
structures  upon  which  the  operations  are  based. 

Once  the  structural  particulars  of  imaging  algorithms  are 
discovered,  they  lead  directly  to  the  proposed  basis.  A  digital 
image  defined  herein  is  a  partial  function  on  ZxZ  into  the  reals, 
that  is,  it  is  a  function  whose  domain  is  a  subset  of  ZxZ  and 
whose  codomain  is  the  real  number  system  R.  An  image  can  be 
described  by  the  domain  being  the  extent  and  codomain 
being  the  grey  value.  The  set  of  all  images  will  be  denoted 
by  X.  It  is  mathematically  natural  to  look  within  the  structures 
of  ZxZ  and  R  to  find  the  primitive  operations  of  image  processing. 
Both  ZxZ  and  R  are  extremely  rich  and  well-studied  mathematical 
entities.  Each  has  an  extensive  structure  from  which  to  draw. 

The  proposed  basis  was  developed  by  drawing  upon  those  domain 
(ZxZ)  and  codomain  (R)  structural  properties  which  play  a  role 
in  digital  image  processing.  As  occurs  through  mathematics, 
these  lead  at  once  to  corresponding  properties  (or,  in  this  case, 
operations)  within  the  new  structure  which  they  together  induce. 
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Therefore,  there  naturally  arises  a  set  of  domain  induced 
(fro.'  ZxZ)  operations  and  a  set  of  codomain  induced  (from  R) 
operatic*' -j .  In  a  sense,  one  might  say  that  these  are  there 
to  be  found.  For  a  successful  image  algebra,  one  needs  to 
select  those  operations  which  are  required  for  the  convenient 
representation  of  digital  imaging  transformations. 

It  must  be  understood  that  while  the  preceding  comments 
provide  a  natural  approach  to  the  basis  selection  problem, 
they  do  not  provide  a  deterministic  methodology.  Pragmatic 
modeling  decisions  must  be  made.  Not  only  does  one  have  to 
search  the  literature  to  see  what  is  going  on,  one  must 
recognize  that  different  images  can  have  different  domains 
within  ZxZ.  The  decision  as  to  how  to  proceed,  when  one 
desires  to  add  two  images  with  different  domains  within  ZxZ, 
must  be  made  in  a  heuristic  manner.  In  making  such  decisions 
for  the  proposed  basis,  an  attempt  has  been  made  to  define 
the  elemental  operations  in  a  way  which  reflects  the  manner  in 
which  the  induced  operations  are  most  used  in  practice. 
Fortunately,  it  turns  out  that  in  every  instance  that  has  come 
to  attention,  other  natural  choices  for  the  induced  elemental 
operations  are  derivable  as  terms  in  the  algebra  or  as  macro¬ 
operators  from  the  chosen  basis  set.  These  macro-operators  are 
given  in  a  later  section  along  with  a  rigorous  discussion  of  the 
inducement  process. 

There  now  follows  a  brief  description  of  the  basis  elements 
grouped  according  to  the  manner  in  which  they  have  been  induced. 
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TABLE  C-l .  FUNDAMENTAL  OPERATORS  IN  IMAGE  ALGEBRA 


I 

Addition 

© 

II 

Multiplication 

© 

III 

Maximum 

© 

IV 

Division 

© 

V 

Translation 

T 

VI 

Rotation 

N 

VII 

Reflection 

D 

VIII 

Domain  Extractor 

K 

IX 

Parameter  Extractor 

G 

X 

Existential  Operator 

E 

The  first  four  fundamental  operations  to  be  introduced  are 
range  (codomain)  induced,  and  they  include  addition,  multiplication, 
maximum  and  division.  The  next  three  operations  are  translation, 
rotation,  and  reflection.  They  also  take  digital  images  into 
digital  images;  however,  they  are  domain  induced.  The  final 
three  operations  in  the  basis  do  not  take  Images  into  images. 

They  include  the  domain  extraction  operation,  which  takes  an  image 
and  returns  a  subset  of  ZxZ,  the  parameter  extraction  operation, 
which  maps  an  image  into  the  reals,  and  the  existential  operation, 
which  is  used  in  creating  an  image. 

An  image  is  a  real-valued  mapping  defined  on  a  subset  of  the 
integral  lattice  ZxZ.  Symbolically,  an  image  is  a  mapping 
f:  A  — »  R,  where  A  c  ZxZ.  We  also  employ  the  customary  notation 
for  the  class  of  all  such  mappings,  RA.  Note  that  for  the  null 
set  0c  ZxZ,  we  obtain  the  so-called  null  image,  0  has  an  empty 
domain.  As  for  the  collection  of  all  images,  we  denote  this  class 
by  X  and 


X  =  LJ  RA 
AcZxZ 
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Insofar  as  a  particular  grey  value  of  an  image  f  €  RA  is 
concerned,  this  is  denoted  by  f(i,  j),  where  (i,j)  €  A  c  ZxZ.  The 
first  element  of  the  pair,  i,  gives  the  position  on  the  x-axis, 
while  the  second,  j,  gives  the  position  on  the  y-axis . 

E sample  1 :  Let  A  =  {  ( —  1,0),  (0,0),  (1,0),  (0,1),  (1,1),  (1,2)  }, 

and  define  the  image  f  e  RA  by 

f(-l,0)  =  2 

f(  0,0)  =  3 

f  (  1,0)  *  -4 
f(  0,1)  =  0 

f(  1,1)  =  1/2 

f(  1/2)  =  2 

Graphically,  one  can  illustrate  f  in  the  following  manner: 


Each  pair  (i, j)  corresponds  to  a  square  pixel  which  is  given 
the  grey  value  f(i,j).  It  should  be  noted  that  the  solid  lines 
are  used  to  separate  the  coordinate  values  from  the  grey  value 
table.  Notice  also  that,  for  this  example,  we  have  used  arrows  to 
indicate  the  positions  of  the  x-axis  and  the  y-axis.  In  general, 
the  actual  ordered  pair  (i,j)  is  positioned  in  the  center  of  the 
(i, j) -pixel . 

One  can  interpret  the  grey  value  f(i,j)  as  the  height  of  a 
three  dimensional  bar  graph,  where  the  darker  values  have  greater 
heights.  The  following  example  illustrates  this  interpretation. 
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Example  2 : 


Bar  graph  interpretations  must  be  made  with  care  because 
images  may  have  negative  grey  values  due  to  processing. 


a.  Addition  (Range  Induced).  Since  each  pixel  in  the 
domain  of  an  image  has  a  grey  value  which  is  an  element  of  R,  the 
real  number  system,  and  since  there  is  a  natural  addition  (+)  in 
R,  there  is  an  induced  addition  defined  as  a  binary  operation  on 
images.  This  image  addition  is  denoted  by  ©  and  is  a  basis 
operation.  For  each  pixel  in  the  intersection  of  the  input 
domains,  the  output  image  has  the  arithmetic  sum  of  the  input 
grey  values  at  that  pixel.  For  a  pixel  which  lies  in  one  of  the 
input  domains  but  not  both,  the  decision  has  been  made  to  leave 
its  grey  value  unchanged,  A  similar  decision  has  been  made 
regarding  the  multiplication  operator  and  the  maximum  operator, 
each  of  which  will  be  considered  in  turn.  We  define©:  XxX— »X  as 
follows : 


If  the  domain  of  f  is 
domain  of  f  ©  g  is  A  U  B  and 


(f  ©g)  (x,y)  = 


and  the  domain  of 

g 

is 

B, 

then  t 

f  (x,y) 

t  „ 

'Y) 

e 

A 

B 

g  (x,y) 

u 

tY ) 

€ 

B 

— 

A 

f  ( >-  r  y )  +  g(>:,y) 

(:*: 

t  y) 

€ 

A 

n 

B 

undefined 

(:•: 

fY) 

A 

u 

B 

This  operation  is  illustrated  in  Figure  C-l . 
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I—  ADD  GREY  VALUES  IN  REGION  COMMON  TO  BOTH  f  AND  g 


f 


GREY  VALUES  OF  g  UNALTERED 

f  +  g  HAS  DOMAIN  EQUAL  TO  THE  UNION  OF  THE 
DOMAINS  OF  THE  ORIGINAL  IMAGES 


GREY  VALUES  OF  f  UNALTERED 


Figure  C-l .  Venn  Diagram  for  Addition 


Enample  3 : 

Consider  the  images  f  and  g 


f 


1 

2 

3 

1 

0 

4 

-3 

8 

0 

1 

2 

The  addition  of  f  and  g 
following  diagram. 


illustrated  below. 


9 

2 

7 

8 

1 

0 

5 

0 

1 

3 

0 

1 

2 

is  f  ©  g  and  is  given  in  the 


f  ©  g 


~2 

7 

8 

grey  value  at  pixel 

1 

2 

8 

1«- 

—  (2,1)  equals  grey  value 
of  f  at  pixel  (2,1) 

“o" 

5 

0 

8 

0 

1 

2 

3 

grey  value  at  pixel  (0,1)  is 


2  +  0*2. 


b.  Multiplication  (Rang*  Xnducad).  Similar  reasoning  as 
given  in  the  addition  operation  is  applied  to  the  natural 
multiplication  (•)  in  R.  The  result  is  a  pi:*:elwise  induced 
multiplication  operation  on  pairs  of  input  images.  For  a  pixel 
in  the  intersection  of  the  domains  of  the  input  images,  the 
corresponding  grey  values  are  multiplied.  On  the  other  hand,  the 
grey  value  of  a  pixel  which  lies  in  only  one  domain  of  the  input 
images  is  left  invariant. 

Hence  we  define  the  binary  operator 

©  :  X  x  X  —»  X,  where  the  operands  are  images  and  the  output 
is  also  an  image,  as  follows: 

Let  the  domain  of  f  be  A  and  the  domain  of  g  be  B.  Then  the 
domain  of  f  ©  g  is  A  U  B  and 

f(x,y)  (x,y)  €  A  -  B 

'  g(x,y)  (>wy)  e  b  -  a 

f(x,y)  •  g  (x,  y )  (>:,y)  e  A  n  B 

.  undefined  (x, y)  £  A  U  B 

This  operation  is  illustrated  in  Figure  C-2 . 

MULTIPLY  GREY  VALUES  IN  REGION  COMMON  TO  BOTH  f  AND  g 

GREY  VALUES  OF  g  UNALTERED 

f  •  g  HAS  DOMAIN  EQUAL  TO  THE  UNION  OF  THE 
DOMAINS  OF  THE  ORIGINAL  IMAGES 

-  GREY  VALUES  OF  f  UNALTERED 

Figure  C-2.  Venn  Diagram  for  Multiplication 


(f  ©  g)  y)  = 
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Example  4: 


If  f  and  g  are  given  in  Example  3,  then  f  ©  g  is  illustrated 
below . 


2 

7 

8 

1 

0 

15 

1 

0 

4 

-9 

8 

0 

1 

2 

'T 

c.  Maximum  (Ranga  Induced).  Given  two  real  numbers  in  R 
there  is  a  natural  order  operation  called  maximum.  Simply 

stated,  for  two  real  numbers  y  and  z,  y (v) z  is  either  y, z  or  their 
common  value,  depending  respectively  upon  whether  y  is  greater,  z 
is  greater  or  they  are  equal.  This  naturally  induces  a  pixelwise 
maximum  on  the  intersection  of  two  input  domains.  Once  again, 
the  heuristic  determination  has  been  made  to  leave  the  input 
images  unaltered  off  the  intersection.  The  operation  is  denoted- 
by@  . 


We  define  (v)  :  X  x  X  — »  X,  where  the  domain  of  f  is  A  and  the 
domain  of  g  is  B,  then 


(f  ©  g) 


f  (x,y) 

<x,y) 

6 

A 

-  B 

gU/y) 

(x,  y) 

€ 

B 

-  A 

=  < 

f  (x,  y)  v  g  (x,  y) 

(Xf  y) 

6 

A 

n  B 

undefined 

<x,y) 

A 

U  B 

An  illustration  is  given  in  Figure  C-3 . 


f _  take  maximum  of  grey  values  in  region  common  TO  f  AND  g 


GREY  VALUES  OF  g  UNALTERED 

f  g  HAS  DOMAIN  EQUAL  TO  THE  UNION  OF  THE 
DOMAINS  OF  THE  ORIGINAL  IMAGES 


GREY  VALUES  OF  f  UNALTERED 


Figure  C-3.  Venn  Diagram  for  Maximum 


Example  5: 


If  f  and  g  are  given  as  in  Example  3  then  f@g  is  illustrated 
below. 


2 

7 

8 

1 

2 

5 

1_ 

0 

4 

3 

T1 

1 

2 

3 

d.  Division  (Rang*  Induced).  Each  grey  value  Z  which  is 
not  zero  has  a  reciprocal  grey  value  1/z.  Hence  there  is  a 
natural  image  operation,  called  division,  which  replaces  each 
nonzero  grey  value  by  its  reciprocal.  It  is  denoted  by  ©  .  Since 
in  R  the  reciprocal  of  zero  is  undefined,  it  has  been  decided 
that  the  division  operation  should  leave  the  output  image 
undefined  at  any  pixel  for  which  the  input  image  has  grey  value 
zero . 


Consequently,  0  :  X  X,  where  if  there  is  a  zero  pixel  in 
the  input  image  then  the  output  image  has  a  smaller  domain  than 
the  input . 

Specifically,  (  © f )  (x,y)  -  l/f(x,y)  if  f(x,y)  *  0,  and  is 
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undefined  if  f'x,y)  -  0.  When  the  division  is  preceded  by  a 
multiplication  operator  @  ,  we  shall  omit Q  .  A  diagram  of  this 
operation  follows: 


t 


BEFORE 

« 


GREY  VALUE  a* 
_ GREY  VALUE  - 


0 

0 


AFTER 


.GREY  VALUE  1/a 
_ HOLE  NOT  PART  OF  IMAGE 


Example  6: 

Consider  the  image  g  given  in  .Example  3,@g  is  given  below  in 
the  illustration. 


©g 


2 

1/7 

1/8 

T 

1/5 

~~0 

1 

1/3  1 

0 

1 

2 

*♦3 


•  .  Translation  (Domain  Znduoad).  Given  a  position  vector 
in  two  dimensional  space,  denoted  by  (m,n),  the  vector  addition 
between  (m,n)  and  another  vector  (i,j)  yields  a  new  position 
vector  (m+i,n+j) .  Geometrically,  the  original  position  is  moved 
over  (:■:  direction)  i  units  to  the  right  and  up  (y  direction)  j 
units.  This  position  operation  induces  the  translation  operation 
on  images.  The  elemental  operator  T  moves  an  image  over  and  up, 
while  leaving  grey  values  unchanged.  Notationally,  T(f,i,j)  or 
fi(j  is  used  to  indicate  the  image  obtained  by  moving  it  over  i 
units  and  up  j  units.  It  is  this  domain  induced  operator  T  which 
has  proved  to  be  invaluable  in  the  exploitation  of  the  natural 
parallelism  which  exists  in  many  imaging  operations.  We  define 

T:  X:-:Z::Z  X,  where  T  is  the  trinary  operator  defined  by: 

(T (f , i, j) )  (x,y)  -  f (x-i, y- j) 

An  illustration  follows: 


SAME  GREY  VALUES 


AFTER 


Example  7 : 

Consider  the  image  f  illustrated  below 


44 


vertical  location  * 
of  pixel 


f 


3 

grey  value  of  pixel 

2 

-k 

2 

2 

1 

*s  1#  thAt  is 
£(2,1)  »  1 

►  horiiontal  location 

0 

4 

-3 

8 

0 

1 

2 

3 

of  pixel 


The  translate  of  f ,  i-2  units  to  the  right  and  j-1  units  up 
is  denoted  by  T(f,2,l)  -  f2#1  and  is  illustrated  below. 


f2,l 


2 

2 

2 

1 

1 

4 

-3 

8 

0 

0 

1 

2 

3 

4 

f.  Ninety  Degree  Rotation  (Domain  Induced).  A  set  of 

ordered  pairs  in  the  two  dimensional  lattice  ZxZ  can  be  rotated 
90  degrees  in  the  counter-clockwise  direction.  This  at  once 
induced  a  ninety  degree  rotation  operation  N.  The  grey  values  of 
the  input  image  are  left  unchanged  and  the  image  is  simply 
rotated.  Consequently:  N  :  X  X  by 


<N{f) )  (x, y)  -  f  (y,  ->:)  . 


The  illustration  given  below  depicts  how  N  rotates  the  image 
f  counter-clockwise  about  the  origin  a  full  90  degrees  and  does 
not  otherwise  alter  it. 


AFTE 


THE  DOMAIN  IS  ROTATED,  THE  GREY  VALUES 
ARE  FIXED  AND  DO  NOT  CHANGE  RELATIVE 
TO  THE  DOMAIN. 


.BEFORE 


90° 
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Example  8 : 


If  the  image  g  is  given  in  Example  3,  then 
illustrated  below. 

9  N(g) 


2 

7 

8 

” 2 

1 

0 

5 

6 

5 

T" 

0 

1 

3 

“0 

7~~ 

0 

T" 

6 

1 

"T 

T~ 

T 

N(g)  is 


g.  Diagonal  Reflection  (Domain  Induced).  This  operation  is 
similar  in  origin  to  the  90°  rotation,  except  that  the  image  is 
flipped  out  of  the  page  around  a  135°  line  through  the  origin. 
This  operation  is  denoted  by  D.  D  :  X  -+  X,  where  (D(f))  (x,y)  * 

f  (-y, -x) .  Hence  D  makes  row  pixels  become  column  pixels  (and 
conversely)  by  rotating  the  image  180°  out  of  the  page  about  the 
-45°  axis.  That  is,  it  flips  the  image  as  illustrated  below. 


Example  9 : 

Consider  the  image  g  given  in  Example  3. 
illustrated  below. 


D(g) 


i 

0 

7 

0 

1 

-l 

8 

5 

3 
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-1 

0 

1 

Then  D (g)  is 
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h.  Domain  Extractor.  The  domain  of  an  ir  ge  i~  a  subset  of  2xZ. 
It  is  natural  and  convanient  to  consider  the  operation  K  which 
*  takes  an  image  and  yields  a  subset  of  ZxZ,  that  subset  being  the 

domain  of  the  image.  Hence  K  :  X  -»  2***  and  for  f  in  R*,ACZxZ, 
K(f)  -  A. 


f 


INPUT  OF  OPERATOR  K 


i 


JS - ► 


(i,  j)  .  .  .  . 


j 


OUTPUT  OF 
OPERATOR  K 


Example  10: 

Consider  the  image  f  illustrated  in  Example  3. 


1 

0 


The  domain  extraction  operation  performed  on  f  is  K(f) 
and  K(f)  -  {  (0,0),  (0,1),  (1,0),  (1,1),  (2,0),  (2,1)  }. 

i.  Parameter  Extractor.  Each  pixel  in  the  domain  of  an 
image  has  a  given  grey  value.  It  is  often  necessary  to  read  out 
that  value,  which  is  an  element  of  R,  the  codomain.  It  turns  out 
that  it  is  only  necessary  to  assume  the  ability  to  extract  the 
grey  value  at  the  origin  pixel.  Others  can  be  found  by  first 
applying  the  appropriate  translations.  This  basis  operation 
yields  the  grey  value  at  the  origin  pixel  for  a  given  input 
image.  The  complexity  of  the  rigorous  definition  results  from  the 
desire  to  have  this  operator  defined  even  if  the  grey  value  at 
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the  origin  is  undefined.  In  that  event,  the  closest  grey  value 
it  chosen.  This  latter  stipula.ion  is  essentially  just  a 
mathematical  formality  since  it  is  possible  to  move  any  grey 
value  to  the  origin  by  translation.  The  operator  G  extracts  the 
grey  value  of  the  pixel  which  is  closest  to  the  origin  in 
Euclidean  distance  and  at  the  smallest  angle  from  the  abscissa. 


Hence  G:  X  — »  R,  where 


[f(0,0)  when  f  e  R*  and  (0,0)  €  A 
G(f)  =  jo  when  f  =  0 

lf(i,j)  otherwise,  where  tan_1(j/i) 
is  minimized  for  minimum 
i2  +  j2. 


The  operation  is  illustrated  below. 


OBTAIN  GREY  VALUE  OF  THIS  PIXEL 


Example  11: 


Consider  the  image  f  given  in  Example  3.  Then  G(f)  *  4 
since  f (0, 0)  =  4  . 


j.  Existential  Operator.  Somewhat  opposite  of  the  domain 
finding  operation  and  parameter  extraction  operation  is  the 
Existential  Operator  E.  This  operator  is  a  binary  operator  used 
in  manufacturing  ar.  image.  The  inputs  of  this  operator  are  a 
grey  value  t  and  a  subset  A  of  ZxZ.  The  output  is  a  constant 
image  with  domain  A  such  that  every  pixel  in  A  has  grey  value  t. 
Such  an  image  is  denoted  by  tx;  i.e.,  tx(i,j)=»t  €  R;  for 
(i,j)  €  A  and  is  undefined  elsewhere.  Thus  we  define 
E  :  R  x  2ZxZ— >  where  for  t  e  R  and  A  e  2ZxZ,  E(t,A)  -  tx. 
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Notice  that  E(2,{  (0,0),  (0,1),  (1,0),  (1,1)  })  is  given  by: 


The  aforementioned  operations  form  the  proposed  basis.  Each 
taken  individually  is  very  simple  in  its  structure.  Yet  taken  as 
a  collection,  they  possess  a  powerful  spanning  capability  insofar 
as  the  following  transformation  types  are  concerned:  image  to 
image,  image  to  parameter  and  image  to  set.  Both  their 
simplicity  and  their  power  result  from  the  inducement  methodology 
(described  in  para  9)  which  brings  them  to  light. 


3.  MACRO  OPERATIONS  IN  THE  IMAGING  ALGEBRA 


In  the  previous  section,  the  fundamental  operations  in  the 
imaging  algebra  were  introduced.  These  operations  are  either 
directly  or  indirectly  used  in  describing,  representing,  or 
expressing  important  image  processing  operations.  A  hierarchy  of 
operations  is  a  beneficial  approach  in  this  representation.  The 


49 


fundamental  operations  can  be  thought  of  as  components  in  a 
system.  By  utilizing  numerous  components,  subsystems  are  created 
and,  as  a  whole,  the  system  is  comprised  of  several  subsystems. 

In  the  imaging  algebra,  macro  operations  act  like  the 
subsystems.  Each  macro  operation  is  formed  from  the  fundamental 
operations  using  function  composition  and,  as  such,  each  of  the 
ten  fundamental  operations  are  themselves  elemental  macros.  In 
the  universal  algebra,  macro  operations  are  also  called  terms  for 
the  algebra.  Finally,  these  macro  operators  are  ultimately 
employed  again  using  function  composition  in  forming  image 
processing  operations.  These  image  processing  operations  are 
indirectly  represented  in  terms  of  the  ten  fundamental 
operations.  However,  if  desired,  a  direct  representation  in  terms 
of  this  basis  can  always  be  given,  but  this  expression  will  often 
be  long  and  tedious. 

In  this  section,  several  macro  operations  shall  be 
described,  along  with  their  basis  representations.  This 
presentation  is  also  given  in  a  hierarchal  manner.  Once  macro 
operations  are  defined,  they  might  be  employed  in  describing  a 
later  macro  in  conjunction  with  the  utilization  of  fundamental 
operations . 

In  addition  to  defining  macros  which  take  images  (that  is, 
elements  of  X  *  u  RA)  into  images,  macros  will  be  given 

AcZxZ 

involving  other  sorts  of  sets.  In  particular,  the  set  of  all 
images  with  finite  domain  will  be  needed.  Here,  Y  -  u  RA  and  it 

AcZxZ 

is  noticed  that  Y  c  X.  Additionally,  the  set  of  all  binary 
images  B  will  be  used  in  defining  some  macro  operations.  In  this 
case,  B  =■  U  {0,1  }x  and  B  c  X.  Other  than  these,  macros  will  be 

AcZxZ 

given  with  domain  or  codomain  involving  the  subsets  of  Z:-:Z  or  the 
reals  respectively. 
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a.  Subtraction  Macro 


(1)  Description.  Grey  values  in  an  image  f  can  be  negated. 
This  is  done  by  employing  the  subtraction  operation (3) to  the 
image  f,  where 


0  :  X  X 

This  operator  has  an  operand  which  is  an  image,  and  the  result  of 
the  operation  is  an  image  with  the  same  domain  as  the  original 
image.  Furthermore, 


(©  f)  (x,y)  -  -f  U,y) 

When  the  unary  operator  0  is  preceded  by  0 ,  it  is  customary  to 
omit  the  0  . 

(2)  Basis  Representation.  The  subtraction  operation  is 
most  easily  found  by  utilizing  the  existential  operator,  along 
with  the  domain  finding  operator  and  multiplication  operator. 
Thus , 


0  f  -  E(-l,K(f))  ©f. 


b .  Minimum  Macro 

(1)  Description.  Similar  to  the  maximum  operation 
previously  discussed,  there  is  the  minimum  operation©  .  This 
operator,  when  applied  to  two  images,  gives  the  pixelwise  minimum 
value  of  grey  on  the  intersection  of  the  domains  of  the  two 
images.  On  the  symmetric  difference  of  the  domains,  the  grey 
values  remain  unchanged.  Hence 

©  :  X  x  X  — >  X 
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where (a) is  a  binary  operator  which  has  operands  that  are  images, 
and  it  yields  an  image  as  output.  Let  the  domain  of  f  be  A,  and 
the  domain  of  g  be  B  then 


(f  ©  g)  (:-:,y)  = 


f  U/y) 

9(^y) 

f  (afy)  ©  g(:-:,y) 

undefined 


(>:,y)  s  A  -  B 

(:-:,y)  6  B  -  A 

(:-:,y)  €  A  n  B 

(:*:,y)  *  A  U  B 


(2)  Basis  Representation.  The  minimum  macro  operation  is 
represented  by  employing  the  maximum  operator  and  the  subtraction 
macro: 


f©g  *©(©f©  ©g) 


c.  Scalar  Multiplication  Macro 

(1)  Description.  It  is  convenient  to  define  a  scalar 
multiplication  operation  A  which  is  similar  to  the  scalar 
multiplication  in  a  vector  space.  Here,  an  image  f  is  to  be 
multiplied  by  a  given  real  number  a  and  the  result  will  be  an 
image  whose  grey  value  at  a  given  pixel  is  a  times  the  original 
grey  value.  Thus, 


A:  R  x  X  — >  X 

where  A  is  a  binary  operation  with  operands  being  an  image  and  a 
real  number  and  the  output  being  an  image.  Furthermore, 

(  a  A  f)  (x,y)  *  a  •  f  (x,y) 

This  operation  is  also  often  denoted  by  Ctf . 
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(2)  Basis  Representation.  The  scalar  multiplication  macro 
is  obtained  under  function  composition  utilizing  the  existential 
operation  in  addition  to  the  domain  extractor  and  the 
multiplication  operations.  Hence, 

a  A  f  =  E  (a,  K(f) )  ©  f . 


d.  Zero  and  One  Image  Macros: 

(1)  Description,  Among  all  the  constant  images,  that  is 
images  whose  pixels  all  have  the  same  value,  the  zero  and  one 
images  are  most  useful.  The  zero  image  with  domain  A  is  denoted 
by  0A. 


(2)  Basis  Representation.  Any  constant  image  is  easily 
found  using  the  existential  operation;  indeed, 

0A  -  E  ( 0 ,  A) 

and 

1*  -  E(1,A) 

a.  Complementation  Macro 

(1)  Description.  Let  f  be  a  binary  image  over  the  set  A, 
that  is,  f  in  {0,1}A.  Then  the  complementary  image  fc  is  also  an 
element  of  {0,1}A.  It  is  defined  by 


f  0 

if 

f  (if  j 

)  =  1 

fcu,  j: 

1 

if 

f  (if  j 

)  =  o 

• 

l  undefined 

if 

(if  j) 

fE  A 

The  complementation  operator  C  is  defined  by 


C  :  B  — »  B 
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by 


C(f)  -  f* 


where 


B  -  LJ  {0,1}* 

AcZxZ 

is  the  collection  of  all  binary  images. 

(2)  Basis  Representation.  Complementation  is  easily  found 
using  addition,  subtraction  and  the  identity  image. 

Let  f  be  an  element  of  {0,1}*.'  Then 

f e  *  [  ©  f  ]  ©  lx 

where  1A  is  the  image  consisting  of  ones  on  the  subset  A  of  Z>:Z . 
Notice  that  1A.  =  E  [  1,  K(f)  ]  . 

f .  Rotation  Macros  (N2  and  N3) 

(1)  Description.  While  the  basis  operator  N  rotates  90°, 
it  is  often  necessary  to  rotate  180°  or  270°.  The  operators  N2 
and  N3  respectively  accomplish  these  rotations. 

We  define 


by 


N2  :  X  X 

N2 (f )  (i, j)  =  f (-i,-j). 


and 
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N3  :  X  ->  X 


by 


N3 (f ) (i, j)  *  f ( j, -i) 


(2)  Basis  Representation.  The  above  rotation  operators  are 
given  by 


N2  -  N[N(f )  ]  , 

and 

N3  «  N2  [N  ( f )  ] 


g.  Horizontal  Reflection  Macro 

(1)  Description.  In  order  to  reflect  or  flip  an  image 
around  the  ::-a:-:is,  we  define  the  horizontal  flip  macro 


by 


F  :  X  X 

F(f)  (if  j)  -  f  (i,-j) 


(2)  Basis  Representation  The  operator  F  is  given  by 

F  (f)  -  N  [D  ( f )  ] 


where  N  is  the  90°  rotation  basis  operator  and  D  is  the  diagonal 
flip  basis  operator. 

h.  Vertical  Reflection  Macro 


(1)  Description.  In  order  to  reflect  an  image  around  the 
y-axis  we  define  the  vertical  flip  macro 


by 


V  :  X  ->  X 
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V(f) (i, j)  -  f (-if j) 


(2)  Basis  Representation.  The  vertical  flip  macro  is  given  by 

V(f)  -  N3  [D  (f )  ] 

where  N3  is  the  270®  rotation  basis  operator  and  D  is  the 
diagonal  flip  basis  operator. 

i.  45°  Reflection  Macro 

(1)  Description.  In  order  to  reflect  an  image  around  the 
45°  line  y  *  we  define  the  45°  diagonal  reflection  operator 

D0  :  X  — »  X 
by 

D0(f)  (if j)  -  f(jfi)  . 


Figure  C-4.  Illustration  of  45°  Reflection  Macro 


(2)  Basis  Representation.  The  45°  diagonal  reflection 


56 


macro  is  given  by 


«  D0(f)  -  N[F<f)  ], 

where  N  is  the  90°  rotation  basis  operator  and  F  is  the 
horizontal  flip  macro. 


j .  Zero  Divide  Macro 


(1)  Description.  At  times,  it  is  useful  to  consider  a 
division  operation  which  takes  images  into  images  by  taking  the 
reciprocal  of  non-zero  grey  values  at  a  given  pixel  and  leaving 
zero  grey  values  unchanged.  Consequently,  we  define 


by 


©o  :  X  -+  X 


1/f  (i, j)  if  f (i, j)  9ft  0 
0o  f  (i,  j )  -  0  if  f  (i,  j )  -  0 

undefined  if  (i,j)  €  K(f) 


When©  is  preceded  by©,  we  often  leave  out  the  multiplication 
symbol  ©  . 

(2)  Basis  Representation.  This  operation  is  found  by  using 
division,  addition,  and  the  zero  constant  image. 

Let  f  be  an  element  of  RA.  Then 

©of  -  <©f>  ©0* 
where  0A  =  E[0,K(f)]. 
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k .  Threshold  Maoro 


(1)  Description.  Numerous  threshold  operations  exist; 
however,  they  all  are  binary  operations  which  take  an  image  and  a 
real  number  into  a  binary  image.  We  begin  with  one  variation  of 
threshold.  The  threshold  operator  is  defined  as  follows: 


X:  X  x  R  -»  B 


by 


X(f , t) (i,  j) 


1  if  f (i, j)  £  t 

'  0  if  f(i,j)  <  t 

.  undefined  if  (i,j)  €  K(f) 


To  simplify  notation,  we  usually  write 

X  (  •  )  -  x(  •  ,t) 

In  particular,  we  shall  most  often  concern  ourselves  with 
thresholding  at  0,  and  in  this  case  X„  represents  the  operation 
at  hand. 

(2)  Basis  Representation.  This  operation  is  constructed 
from  the  minimum,  zero  divide,  complement,  subtraction,  scalar 
multiplication,  as  well  as  zero  and  one  images.  Let  f  be  an 
element  of  RA  and  t  be  a  real  number. 

Then 

Xo(f>  -  C(f  ©0*)  ©o  (f  ©0A)]  = 

and 

Xt(f)  -  X0(f  ©t  A  lK) 
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1.  Variations  of  Thresholding  Macros 


(1)  Description.  The  threshold  operator  Tt  has  been 
defined  utilizing  the  inequality 

f (i, j)  £  t 

Four  variations  of  the  underlying  threshold  operation  will  be 
defined  in  accordance  with  the  solution  sets  of  the  following 
equations: 


(a)  f  (i,  j)  £  t 

(b)  f  (i,  j)  >  t 

(c)  f  (if  j)  <  t 

(d)  f  (i,  j)  -  t 


The  corresponding  macro  threshold  operators  will  be  respectively 


denoted  by  x1  ,  Xa,  X3,  and  X4. 

by: 

(a)  X*t  (f)  (if  j)  -  |  q 

(b)  Xat(f)  (if  j)  -  {  J 

(c)  x3t(f)  (i,  j)  =  |  lQ 

(d)  x4t(f)  (if  j)  “  {  J 


They  are  respectively  defined 


f (if  j)  £  t 
f (i, j)  >  t 

f (if  j)  >  t 
f (if  j)  *  t 

f (if  j)  <  t 
f (if  j)  i  t 

f (if  j)  -  t 
f (if  j)  *  t 


(2)  Basis  Representation.  Let  f  and  t  be  elements  of  RA  and  R 
respectively.  Then 


(a)  x\(f)  -  x.t(  Q  f) 

(b)  xat  ( f )  -  [x3t(f)]° 

(c)  x3t ( f )  -  [xt(f)]° 

(d)  x4t ( f )  -  xt(f)  ©Tit(f) 
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a.  Clipper  Macro 


(1)  Description.  The  threshold  operation  gives  a  binary 
image  which  has  grey  value  1  on  those  pixels  in  which  f  exceeds 
or  is  equal  to  some  given  input  threshold  value.  The  clipper 
acts  in  an  analogous  fashion  in  that  it  leaves  f  unaltered  on  the 
pixels  for  which  it  is  greater  than  or  equal  to  some  threshold 
value  and  it  sets  the  image  equal  to  zero  where  it  is  less  than 
that  threshold  value.  We  define 

CL  :  X  x  R  -4  X 


by 


CL(f,t) (i,  j) 


f  (i, j)  if  £  (if j)  t 
0  if  f(i,j)  <  t 

undefined  if  (i,j)  «  K(f) 


(2)  Basis  Representation,  The  clipper  operation  is  found 
using  the  thresholding  macro  in  addition  to  multiplication.  Let 
f  be  an  image  and  t  a  real  number.  Then 


CL(f,t)  -  f©Tt(f) 

Notice  that  corresponding  to  the  four  variations  of  thresholding, 
there  are  four  variations  of  clipping.  These  are 


CLMfft)  -  f©x\(f) 


for  k  *  1,2,3  and  4. 

n.  Positive  end  Negative  Part  Macros 

(1)  Description.  The  positive  and  negative  part  macro 
operations  take  images  into  images,  and  both  yield  images  without 
negative  grey  values.  The  positive  part  of  an  image  f  is  the 


60 


4 


image 


f+(i, j) 


if  *  0 

if  f(i,  j)  <  0 


f  (if  j) 
0 


The  negative  part  of  an  image  f  is  the  image 


f' (if  j) 


if  f(i,j)  *  0 
if  f (i, j)  >  0 


(2)  Basis  Representation.  The  positive  part  of  an  image  is 
found  using  thresholding  and  multiplication,  while  the  negative 
part  uses  subtraction  in  addition  to  these  other  operations. 
Thus, 


f+  -  t0(f)  ©  f 


•  and 


f*  -  [t0(©f)3  ©  t©f] 

It  is  interesting  to  notice  that 

f+  -  CL  (f ,  0) 


and 


*  -  t*©f- 

o.  Absolute  Value  Macro 

(1)  Description.  Given  an  image  f,  the  absolute  value 
operator  yields  an  image  whose  pixel  values  are  the  absolute 
values  of  the  original  pixel  values.  Therefore, 

AB  :  X  ->X 
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where  the  usual  notation  for  absolute  value  is  often  used  instead 
of  the  prefi:-:  notation.  Thus, 


AB(f)  -  i  f  | 

In  any  case,  |  f  |  is  defined  as 


!  f  I  (i,  j) 


f  < i , j )  if  f (i, j)  £  0 

*  -f (i, j)  if  f (i, j)  <  0 

.  undefined  if  (i,j)  t  K(f) 


(2)  Basis  Representation  Absolute  value  is  defined  in 
terms  of  the  positive  and  negative  parts.  For  any  image  f,  we 
have 


AB  (f)  =  f+  ©  f' 


p .  Support  Macro 

(1)  Description.  The  support  of  an  image  is  often  defined 
to  be  the  subset  of  pi:-:els  where  the  image  is  defined  and  has 
grey  value  not  equal  to  0.  In  a  somewhat  similar  manner,  the 
support  macro,  supp,  is  defined  to  be  an  unary  operator  which 
takes  an  image  .into  a  binary  image: 


where 


supp  :  X  — >  B 


supp  (f )  (i,  j) 


1  if  f (i, j)  *  0 
0  if  f(i,j)  =  0 


(2)  Ensis  Representation.  'the  support  macro  is  defined  in 
terms  of  the  thresholding  macro,  the  complementation  macro,  the 
absolute  macro,  and  the  subtraction  operation: 


supp(f)  -  (T0[  0  I  f  i  ]  )° 
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q.  Addition  Macro 


(1)  Description,  It  is  often  convenient  to  have  an 
addition  operator  which  adds  two  images  only  on  the  intersection 
of  the  domains  and  has  that  intersection  as  the  domain  of  the 
final  output.  We  define 

Cl  :  X  X  X 


by 

Cl  (f ,  g)  (i,  j) 


f(i/  j)  +  g(i,  j)  for  (i,  j)  €  A  n  B 
undefined  elsewhere 


where  f  has  domain  A  and  g  has  domain  B  in  ZxZ . 

(2)  Basis  Representation.  The  macro  is  defined  using 

function  composition  involving  the  fundamental  addition, 

division,  and  multiplication  along  with  the  zero  and  one  constant 
image.  Let  f  be  an  element  of  RA  and  g  be  an  element  of  RB. 
Then 

Cl( f,g)  -©  [©  (If  ©g]  ©  [1  AOB  1  OjknB 

r .  Multiplication  Macro : 

(1)  Description.  It  is  often  convenient  to  have  a 
multiplication  operator  which  multiplies  two  images  only  on  the 
intersection  of  the  domains  and  has  that  intersection  as  the 
domain  of  the  final  output.  We  define 


for  (i,  j )  €  A  n  B 
el sewhere 
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where  f  has  domain  A  and  g  has  domain  B  in  ZxZ . 

(2)  Basis  Representation.  Let  f  be  an  element  of  RA  and  g 
be  an  element  of  RB.  Then 

M(f,  g)  =  d( f  ©  g,  0^  ) 


a.  Divide  Macro 


(1)  Description.  Whenever  we  write  f  (+) g,  by  convention  we 
mean  f  (•)  [©9]  •  As  a  result,  if  the  domains  of  f  and  g  are  A 
and  B  respectively  then  the  output  image  is  defined  on  the 
intersection  of  {(i,j)€B  such  that  g(i,j)  *  0}  with  A.  One  might 
wish  the  output  domain  to  be  a  subset  of  the  domain  of  f.  We 
define 


D  :  X  x  X  ->  X 


by 

(f,g) (i, j) 

(2)  Basis  Representation.  This  macro  is  described  in 
terms  of  the  multiplication  macro  and  the  fundamental  division 
operation : 


{f(i,j)  /  g (if  j)  if  both  f  and  g  are  defined 

at  (i/j)  and  if  g(i,j)  *  0 
undefined  elsewhere 


D( f,g)  =  M( f©  g) 

t .  Higher  (Maximum  Macro) 

(1)  Description  Like  the  addition  macro  and  the 

multiplication  macro,  there  exists  a  maximum  macro,  called 
higher.  It  is  given  by 
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H  :  X  X  -*  X 

where 

.v  J  v  g(i/  j)  for  (i,j)  €  A  n  B 

ri  (f ,  g)  (1,3)  “1 

l  undefined  elsewhere 

A  being  the  domain  of  f  and  B  being  the  domain  of  g. 

(2)  Basis  Representation#  Let  f  be  an  element  of  RA  and  g 
be  an  element  of  RB.  Then 

H  <f,g)  -  f  ©g,!*^  ] 


Note  that 


l*nB  =  M[  1A,  1B] 

u.  Lower  (Minimum  Macro) 

(1)  Description.  The  macro  £  is  defined  in  a  manner 
analogous  to  the  macro  H  except  that  the  minimum  is  involved. 
Indeed, 

£:  X  x  X  -4  X 


by 


£  (f ,  g)  (i,  j) 


f<i,j)  a  g(i,j)  for  (i,j)  e  A  n  B 
undefined  elsewhere 


where  A  is  the  domain  of  f  and  B  is  the  domain  of  g. 

(2)  Basis  Representation,  Let  f  be  an  element  of  RA  and  g 
be  element  of  RB.  Then 


£<f,g)  =  M  [f  ©g,  1*^  ]  . 


65 


V. 


Special  Zero  Macro  Operators 


(1)  Description.  The  following  two  macros  are  related  to 
the  support  macro.  They  are  the  zero  indicator  macro 

Z  :  X  ->  B 


by 


Z(f)  (i,  j> 


1  if  f  (i,j)  =  0 
undefined  elsewhere 


and  the  zero  retainer  macro 

Z'  :  X  B 


by 


Z  '  (f)  (i,  j) 


o  if  f  (i,j)  =  0 
undefined  elsewhere 


(2)  Basis  Representation.  The  zero  indicator  macro 
operations  are  representable  in  terms  of  the  support  macro,  the 
complement  macro  and  the  division  operation.  The  zero  retainer 
is  obtained  from  the  zero  indicator  using  the  multiplication 
macro  and  the  zero  identity  image.  The  zero  indicator  is  given 
by 


Z(f)  =  ©  [  supp(f)  ]C 
and  the  zero  retainer  is  given  by 

z  '  (f)  =  M[0a,  Z(f)] 


where  A  is  domain  of  f. 
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w.  Selection  Operator 


(1)  Description.  The  selection  macro  3  is  similar  to 
operations  on  data  bases.  In  the  imaging  algebra,  S  takes  an 
image  f  in  R*  and  a  subset  B  of  Z::Z  and  returns  an  image  g  which 
has  domain  AnB  and  is  equal  to  f  on  that  domain.  Hence 

S  :  X  2ZxZ  — »  X 


where 


S ( f ,  B)  (i, j) 

and  A  is  the  domain  of  f. 


f (if  j)  for  (i, j )  e  AnB 
undefined  elsewhere 


(2)  Basis  Representation  For  f  in  Rx  and  subset  B  of  Z:-:Z, 
S  =  M(  f,lB)  where  M  is  the  multiplication  macro  and  1B  the  image 
with  grey  values  equal  to  1  on  B. 

x .  Extension  Macro 


(1)  Description.  The  extension  macro  takes  an  image  f  (the 
primary  image)  and  an  image  g  (the  secondary  image) ,  and  outputs 
a  new  image.  This  image  is  identical  to  f  on  the  domain  of  f  and 
is  identical  to  g  on  that  part  of  the  domain  of  g  which  is 
outside  the  domain  of  f.  Hence, 


8  :  X  X  X 


by 


£(f,g)  (if  j)  * 


f (if  j) 
g (if  j) 
lundef ined 


(if  j) 
(i/  j) 
(if  j) 


e  A 

e  B  -  A 
2  A  U  5 


where  f  is  in  RA,  g  is  in  RB  and  B  -  A  is  the  subtraction  of  B 
from  A. 
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(2)  Basis  Representation  The  extension  operation  is  found 
using  the  selection  macro  in  addition  to  using  scalar 
multiplication,  multiplication  and  addition.  With  f  in  Rx, 

£(f,g)  =  [  (0  A  S  (g,k)  )  ©  g]  0  f 

y.  Grey  Level  Summation 

(1)  Description.  Given  an  image  f  in  Y  (the  set  of  all 
images  with  finite  domain)  the  grey  level  summation  macro  I 
outputs  a  real  number  which  is  the  sum  of  the  grey  levels  in  f. 
Hence  define 


So  :  Y  ->  R 


by 


2o(f )  -  I  f  (if  j) 

<i.  j)«* 

where  f  has  domain  A. 

(2)  Basis  Representation.  This  operation  is  described  in 
terms  of  the  selection  operation,  the  translation  operation, 
addition  operation  and  the  grey  value  parameter  extractor.  Let  f 
be  an  element  of  R*.  Then 

XoU>  =G[  IS  [  T.i/  _j  ( f )  ,  {  (0,0)  }  ]  ] 

(i,  j)«A 

Where  G  is  the  grey  value  functional:  G  gives  the  grey  value  at 
the  origin  and  the  summation  implies  a  repeated  use  of  the 
fundamental  addition  operation  ©  .  It  is  interesting  to  note 
that,  by  employing  N2,  I^0(f)  can  be  written  as 

Zo<f>  =  G  [  IS  [  Tifj(f),  {  (0,0)  }  ]  ] 

dim 
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where  £  is  the  domain  of  N2(f)  . 


z .  Gray  Laval  Product 

*  (1)  Description.  Given  an  image  f  with  finite  domain,  the  grey 

level  product  macro  outputs  a  real  number  which  is  the  product  of 
the  grey  levels  in  f.  We  define 

IT0  :  Y  — >  R 


where 


n0(f)  =  rif(i,j) 

U.  j>«* 

and  f  has  domain  A. 


(2)  Basis  Representation.  Let  f  be  an  element  of  R*  with 
A  c  ZxZ  and  card  A  <  «*>.  Then 


no(f)  =  g  [  n  S  [T.i>.j(f),  {  (0,0  }  ]  i 


<i,  j>«A 


In  the  basis  representation,  CL.  denotes  a  repea'  ed  use  of  the 
fundamental  multiplication  operation  ©  and  G  gives  the  grey  value 


at  (0,0). 


aa.  Gray  Laval  Maximum 

(1)  Description.  Given  an  image  f  with  finite  domain  A, 
the  grey  level  maximum  macro  outputs  a  real  number  which  is  the 
maximum  of  the  grey  level  in  f.  We  define 

©o  :  Y  R 

o  (f)  *  V  f (i, j) 

(i.  j> -x 
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(2)  Basis  Representation.  Let  f  be  an  element  of  Rx  where 
A  c  ZxZ  and  card  A  <  oo.  Then 

(v)0  (f)  -  G  [  V  S  [T.i#.a(f),  {  (0,0)  }  ]  ] 

(±.3>«A 

In  the  basis  representation  v^d^jjotes  a  repeated  use  of  the 
fundamental  maximum  operation  (v)  and  G  the  grey  value  extractor. 

bb .  Grey  Level  Minimum 

(1)  Description,  Given  an  image  f  with  bounded  domain, 
the  grey  level  minimum  macro  outputs  a  real  number  which  is  the 
minimum  of  the  grey  levels  in  f.  Hence 

(a)  o  :  Y  — »R 

where 

©»(f)  ;  (A.f<i’3) 

and  f  has  domain  A. 

(2)  Basis  Representation.  Let  f  be  an  element  of  RA,  where 
A  c  ZxZ  and  card  A  <  «*.  Then 

(a)  o  (f )  -  G  [(A.  S  [  T.if.jf  (f ) ,  {  (0,0)  }  ] 

In  the  basis  representation  (iA^denotes  the  repeated  use  of  the 
minimum  macro  operation  and  G  is  the  grey  value  extractor. 

cc.  Restriction  Macro 

(1)  Descripcion.  The  extension  operator  extends  a  given 
image  into  the  domain  of  a  secondary  image.  The  new  domain  is 
the  union  of  the  original  domains.  The  restriction  macro  defined 


herein  restricts  the  primary  image  to  the  intersection  of  its 
domain  with  the  domain  of  the  secondary  image.  Notice  that  no 
new  grey  values  are  defined  by  this  operator.  Thus 

:  X  ::  X  X 


by 


(f,g)  (i,  j) 


f (i, j)  for  (i, j)  €  A  n  B 
undefined  elsewhere 


where  A  is  the  domain  of  f  and  B  is  the  domain  of  g. 

(2)  Basis  Representation.  The  macro  is  obtained  from  the 
selection  macro  and  the  domain  finding  macro.  Let  f  and  g  be 
elements  of  RA  and  RB  respectively.  Then 

SR(f,g>  -S(f,B)  -S(f,K(g)). 

dd.  Dot  Product 

Description.  Suppose  two  images  f  and  g  have  the  same 
(finite)  domain,  say  A.  Then  a  dot  product  can  be  formed  between 
f  and  g  according  to  the  definition. 

Dq{  f,g)  =  X  f  (if  j )  x  g(if  j) 

U,j)«A 

If  the  images  do  not  have  the  same  domain,  then  the  dot  product 
is  undefined.  As  a  result,  Dq  is  not  defined  on  X  x  X.  Instead 

Dq  :  U  RA  x  RA  R 

AaZxZ,  card  A  <  *• 

(2)  Basis  Representation  Let  f  and  g  be  elements  of  RA. 

Then 


£>0<f,g)  =  Z0[f©g] 
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•• .  filtering  Macro 


(1)  Description,  One  of  the  most  common  operations  in 
image  processing  is  that  of  filtering  an  image  by  a  given  mask. 
Since  a  mask  is  nothing  but  an  image  which  is  being  used  for  a 
specific  purpose,  the  filtering  macro  needs  to  make  no  reference 
to  the  term  mask.  We  define 

3  :  Y  x  Y  — >  Y 


by 

X  f(i  +  \1,  j  +  V)  •  g  (u,  v) 

(u',r>*1  if  all  terms  in  the  sum 

are  defined,  and  B  is  the 
domain  of  g. 

undefined  if  there  exists  at  least  one 
undefined  term  in  the  sum. 

(2)  Basis  Representation.  Let  f  and  g  be  elements  of  Rx 
and  RB  respectively.  Then 

3(f,g)  -  Xe  [D0[9t<f,Ti#j(g))f  Ti#j(g)],  {(i,j)H 

(i,  j>«* 


3  (f,g)  (i,  j)  «  j 


where  denotes  the  repeated  use  of  ©  addition. 

f £ .  Pixelvise  Norms  for  Image  Vectors 


(1)  Description.  At  times,  consideration  must  be  given  to 
a  vector  of  images  of  the  form  (fu  f2,  .  . .  ,f„)  where  each  fk  is  an 
image.  For  the  present,  this  discussion  will  be  restricted  to 
the  case  where  all  the  fk  have  the  same  domain.  Once  such  a 
vector  of  images  exists,  a  norming  image  can  be  defined,  i.e.,  an 
image  which  has  at  each  pixel  the  grey  value  which  results  from 
applying  some  given  norm  to  the  vector  of  grey  values  which 
correspond  to  that  given  pixel.  In  other  words,  for  each  pixel 
(i,j)  in  the  common  domain  of  the  fk,  a  real  valued  vector  can  be 
associated. 
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Vi#j  -  (  fx(i,j),  fa(i,j)r  ...r  ) 

Any  norm  can  then  be  applied  to  Vi>3;  however,  this  discussion 
is  restricted  to  the  following 

|  |Vlfj|  I.  »  max  {  |fk(i,  j)  I  } 

k  -  1,2, ...,» 

I  IVi#j|  |x  -  |  f  x  <  i  r  j )  |  +  |f*<i,j)|  +  |  f,(i,  j>  |  +  ...  +  |fn(i,j)| 

a 

I  IVi#j|  |2  -  (Z[fk(i»  j)la)i 

k  -  1 

Three  corresponding  operators  are  defined: 


N.  : 

X 

V  Y 

A 

in  product) 

NX  1 

X 

x  x  X 

...  x  X  — >  X  (m  terms 

in  product) 

N2  : 

X 

X 

...  x  X  X  (m  terms 

in  product) 

These  are 

respectively  defined  by 

N„(fx, 

far 

*  •  •  9 

f .)  (ir  j)  -  1  |Vifj|  1. 

NX<fir 

f  2/ 

•  •  *  f 

f J  (ir  j)  -  1  IVifj|  |x 

N2(fx, 

far 

*  •  •  f 

f »)  (ir  j)  “  1  |V1#j|  |a 

(2)  Basis  Representation.  The  respective  basis  representations 
of  the  preceding  three  operators  are: 

a 

N*(fx,  far  •  •  -  r  f»)  «  VlfjJ 

k-1 

a 

far  •  •  •  r  f J  -  Zlfkl 
k-X 

a 

f2r  fj  *  (S[|fkUa}i 

k-1 


NX(fir 

Na(fx, 
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where  in  the  last  representation,  the  notation  gi  ,  g  an  image 
means  to  obtain  a  new  image  by  taking  the  positive  square  root  of 
each  pixel,  assuming,  of  course,  that  g  has  no  negative  grey 
values.  It  should  be  noted  that  the ( square  root  operator  might  be 
expressed  in  terms  of  basis  operators,  in  which  case,  it  would  be 
only  a  finite  approximation  to  the  actual  square  root.  For 
instance,  a  few  terms  of  the  Newton  Raphson  may  be  employed.  In 
any  case  some  convention  must  be  adopted  regarding  the  square 
root  when  implementing  it  as  a  procedure. 

gg.  Gradient  Type  Edge  Detector 

(1)  Description,  Many  edge  detection  techniques  involve 
filtering  by  two  directional  masks,  one  which  detects  change  in 
the  horizontal  direction  and  one  which  detects  change  in  the 
vertical  direction.  Examples  are  the  usual  gradient,  the  Prewitt 
gradient  and  the  Sobel  gradient.  These  operators  each  have  three 
popular  variants,  the  particular  variant  depending  upon  the 
choice  of  norm.  Consequently,  we  will  introduce  three  edge 
detection  macro  operators,  one  for  each  norm.  Define 

E„  :  X  x  X  x  X  x  R  B 

Ex  :  X  ::  X  x  X  x  R  ->  B 

E2  :  X  x  X  x  X  x  R  — »  B 


by 


E„  (f  ,M,N,  t)  -  Tt[N.{3  (f,M)  ,3  (f,N)  }] 

Ei  (f  ,M, N,  t )  -  Tt  [Ni { 3  ( f , M)  ,3  (f ,  N)  }  ] 

E2(f,M,N,t)  =  Tt[Na{3  (f,M),3  (f,N)  }] 

In  each  of  the  above,  M  and  N  are  images  which,  in  practice, 
represent  directional  ma^ks. 
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(i)  Basis  Representation.  The  above  definitions  are 
themselves  basis  representations. 

A  particular  instance  of  the  gradient  macro  occurs  with  the 
Sobel  edge  detector.  In  this  case,  if  the  image  is  f,  then  the 
input  masks  are  ' 


The  threshold  parameter  t  depends  upon  some  heuristic  or 
knowledge-based  a  priori  decision. 

hh .  Compass  Gradient  Operators 

Description.  In  a  manner  similar  to  the  gradient  type 
operators,  we  shall  describe  a  compass  gradient  type  macro 

r 

.  operator.  It  can  be  used  with  any  set  of  eight  compass  gradient 

masks  such  as  the  Kirsh  or  3-level  masks.  We  shall  leave  out  the 
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thresholding  operation.  It  can  always  be  composed  with  the 
output  of  the  present  macro  to  produce  a  binary  edge  image. 

Ec  :  X  X  ...  X  — ►  X  (8  terms  in  product) 


by 


Ecif,Mx,Ma,  .  .  .,M8)  =  N0.[3(f,M1),  3  (f,M2)  ,  .  .  .  ,3  (f,M„)  ] 

where  in  practice  Mx,  M2,...,  M8  are  masks  of  the  same  dimension. 

An  example  of  the  compass  gradient  macro  occurs  when 
M1,M2,...,  M8  are  the  eight  Kirsch  masks.  Technically,  each 

Kirsh  mask  is  an  image  in  RA,  where  A  consists  of  the  origin 
together  with  its  immediate  neighbors,  both  strong  and  weak.  For 
instance , 


Ml 


+1 

-5 

3 

3 

0 

-5 

0 

3 

-1 

-5 

3 

3 

-1 

0 

1 

ii.  Binary  Morphological  Macro  Operators 

(1)  Description.  Because  of  their  prevalence  in  image 
processing,  it  is  useful  to  define  macro  operators  for  the  four 
basic  morphological  operations.  Each  is  of  the  form 

Operator:  (B  n  Y)  (B  n  Y)  — >  (Bn  Y) 

The  four  macros  are  dilation,  erosion,  opening  and  closing.  They 
are  respectively  given  by 

DI(f,g)  =  ©T,  j(g)  (A  is  the  domain  of  f) 

li.  }l«A 
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ER(  ,g)  =  [DI  {  fc,  N2  (g)  }]<= 


OP  ( f ,  g)  =  ER[DI  {  f ,  N2  (g)  }  ,  N2  (g)  ] 

CL (f , g)  =  DI[ER(f,g)  ,  g] 

(2)  Basis  Representation.  The  preceding  expressions  are 
basis  representations. 

j  j .  Grey  Level  Morphological  Macro  Operators 

(1)  Description.  The  following  four  grey  level 
counterparts  to  the  binary  morphological  macros  given  in 
paragraph  ii  above  are  in  use.  It  should  be  noted  that  there  are 
other  ways  to  generalize  the  binary  morphological  operators.  The 
following  operators  are  of  the  form 

Operator:  Y  Y  ->  Y 

They  are  grey  level  dilation,  grey  level  erosion,  grey  level 
opening,  and  grey  level  closing.  The  are  respectively  defined  by 

DI(f,g)]  (i,  j)  -  E[(v)0{  <Z( ffgirj)},  (i,j)  ] 

ER(f,g)]  (i,  j)  =  E[(V)0{  #(f,  ©gi#j)},  <i,j)  ] 

OP  (f ,  g)  =  ER[DI{f,N2(g)  },N2(g)  ] 

CL(f,g)  =  6 1  [ER  (f ,  g)  ,  g] 

Several  comments  are  in  order: 
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(a)  It  is  assumed  that  the  structuring  element  g  is 
symmetric . 

(b)  In  words,  DI  (f,g)  is  evaluated  at  (i,j)  by  adding  the 
(i,j)  translation  of  g  to  that  part  of  the  image  f  which 
matches  doma.inwise  the  translation  of  g,  talcing  the  maximum 
value  of  that  addition  and  then  making  that  maximum  the  grey 
value  at  (i,  j ) . 

(c)  ER  is  similar  to  DI  except  that  gi(j  is  subtracted  ana  a 
minimum  is  taken. 

(d)  Given  DI  and  ER,  OP  and  CL  are  evaluated  in  a  manner 
similar  to  the  manner  in  which  DI  and  ER  are  obtained  from 
OP  and  CL . 

(2)  Basis  Representation.  The  preceding  expressions  are 
basis  representations. 


4.  ANALYTIC  MACRO  OPERATORS 

Consider  the  complex-valued  function  b(z)  of  a  complex 
variable.  Suppose  that  b(z)  is  analytic  in  the  disk  of  radius  r 
centered  at  the  origin.  Then  b(z)  car.  be  expressed  as  a  power 
series : 

M 

b(z)  =  X  bk  zk 

k-0 

If  b(z,n)  denotes  the  nth  partial  sum  of  the  series,  then 
the  meaning  of  the  series  expression  is  that  lim  b(z,n)  *  b(z) 
for  all  z  such  that  |z|  <  r.  The  purpose  of  this  section  is  to 
formalize  an  extension  of  analytic  functions  to  the  construction 
of  particular  macro-operators  in  the  image  algebra. 
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Suppose  b(z)  is  analytic  and  possesses  the  preceding  power 
series  representation.  Moreover,  let  f  be  an  image  and  n  be  any 
non-negative  integer.  If  f  is  the  null  image,  then  we  define 
b(f,n)  to  also  be  the  null  image.  If  f  is  not  null,  then  we 
define  b(f,n)  by 


n-1 

b(f,n)  =  £  bkf* 

,  k-0 

where 

n-l 

a.  for  n  >  0,  fn  =  FI  f 

k-0 

the  product  being  the  image  product,  (?)  ,  of  f  with  itself  n 

times . 

b  .  f°  =  E  [  1 ,  K  ( f )  ]  . 

c.  bkf  is  the  scalar  multiplication  of  bk  times  f  in  the 

image  algebra. 

d.  The  summation  denotes  image  summation,  (?)  . 

When  viewed  as  a  binary  operator  with  multi-typed  inputs  f 
and  n,  b  is  an  operator  in  the  image  algebra.  It  is  called  an 
analytic  operator.  It  should  be  noted  that  the  definition  of 
b(f,n)  is  a  basis  representation  in  and  of  itself. 

Now  suppose  pi:-:el  (i,j)  is  in  the  domain  of  image  f  By 
construction,  b(f,n)  is  domain  stable  and  hence  (i,j)  is  in  the 
domain  of  b(f,n).  Moreover,  due  to  the  pi:-:elwise  definitions  of 
the  induced  basis  operators  (?)  ,  (?)  ,  and  A, 

n-l 

[b  (f , n)  ]  <i,  j)  =  £  bkf  (i,  j)k 

k-0 

In  other  words,  the  grey  value  of  b(f,n)  at  the  (i,j)  pi:-:el  is 
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the  nth  partial  sum  of  b(f(i,j)). 

[b(f,n)]  (i,j)  =  b [f (i, j ) ,  n]  . 

Although  we  could  have  easily  defined  limits  in  the  image 
algebra  by  inducing  them  from  the  range,  we  have  not  done  so 
since  our  purpose  has  been  to  remain  in  the  digital  mode. 
Nonetheless,  since  [b(f,n)3  (i, j)  is  a  real  number  for  each  n,  it 

does  make  sense  to  take  the  limit  of  the  sequence  {[b(f,n)] 

( i ,  j )  }  as  n— ><».  Since  it  is  assumed  that  b(z)  is  analytic  in  the 
disk  of  radius  r,  if  |f(i, j) |  <  r,  then 

lim  [b  ( f ,  n)  ]  (i,  j)  =lim  b[f(i,j),n]  =b[f(i,j)] 

n— n— >*• 

Put  simply,  if  all  grey  values  of  f  have  absolute  value 
between  -r  and  r,  then  each  pixelwise  limit  is  equal  to  the  value 
of  the  original  analytic  function  at  the  grey  value  of  the  input 
image.  Moreover,  the  result  remains  unchanged  if  f(i,j)  =  u(i,j) 
+  iv(i,j)  is  a  complex-valued  image  and  the  operations  in  the 
image  algebra  are  applied  by  means  of  complexif ication. 

We  now  present  some  particularly  important  instances  of 
analytic  macro-operators.  In  all  cases,  the  fundamental  point  to 
keep  in  mind  is  that  each  is  expressable  directly  in  terms  of  the 
range  induced  basis  elements. 

EXP:  The  exponential  function  e*  is  analytic  in  the  entire 
complex  plane.  It  has  the  power  series  representation 


k-0 


The  corresponding  analytic  macro-operator  in  the  image  algebra  is 
called  the  exponential  operator  and  is  defined  by 


8o 


EXP (f ,n) 


n 


k-0 


-  e [  1 , k ( f ) 3  ©f ©rr[f © f]  ©•••©irrc  f ©f ©  . ..  ©f] 


where  the  last  basis  product  in  the  expression  involves  n 
multiplicands.  Note  that  each  grey  value  of  EXP(f,n)  is  a  finite 
series  approximation  to  the  exponential  of  the  corresponding  grey 
value  of  the  input  image  f;  indeed, 

n 

[ EXP  ( f ,  n )  j  ( i ,  j )  ■  X  f|(1k'lJ)1C 

k-0 

Moreover,  since  e*  is  analytic  m  the  entire  complex  plane, 
for  each  (i,j)  in  the  domain  of  f,  regardless  of  the  grey  value. 


lim  [EXP  (f,n)  ]  (i,  j)  - 

n-M* 

(Note  that  this  limit  is  taken  outside  of  the  image  algebra) 

Example:  Let  f  be  the  image  defined  by  f(0,0)  =  2, 

f(0,l)  =  0,  f(l,0)  *  -1,  and  f(-l,0)  «  1: 


Then  EXP(f,2)  is  given  by: 

[EXP (f , 2) ]  (-1,0)  =  1  + 
[EXP (f , 2) ]  (0,0)  -  1  + 
[EXP (f , 2) ]  (1,0)  =  1  + 
[EXP (f , 2) ]  (0,1)  =  1  + 


ixl-5 

1  +  2  "  7 


,  x  22 
2  +  ~T 


+ 


(-1)  +  —y 
0  +  0  =  1 
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Hence,  the  output  image  looks  like 


2 

1 

1 

0 

5 

2 

5 

1 

2 

-1 

0 

1 

2 

Now  suppose  we  consider  EXP(f,n)  for  arbitrary  n.  If 
pinelwise  limits  are  taken  then 


As  noted 
algebra . 


previously. 


lim  [EXP (f , n) ]  (-1,0) 

=  e 

n— 

lim  [EXP (f , n) ] (0,0) 

=  e2 

n-K* 

lim  [EXP (f , n) ] (1,0) 

-  e_1 

lim  [EXP (f , n) ] (0,1) 

-  1 

n— m* 

these  limits  take  place  outside  the  image 

COS:  Like  e*,  the  cosine  function,  cos  (z) ,  is  analytical  in 
the  entire  plane,  with 

•• 

COS (z)  -  £  (-1)*  (SVj  ) 

V-0 

Consequently,  the  associated  macro-operator  COS  is  defined  in  the 
following  manner:  If  n  is  even,  then 

n/2 

cos  ( f , n)  =  X  (“i ) *  -fiiny 

k-0 

-  E[l,K(f)]  O^r  [f©f]©...©  (-l)n/2FT[  f©f®  ...©f] 


If  n  is  odd,  then 
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COS  <f,n) 


(b-1)/2 

-  S  (-Dk  jSyr 

k-0 

The  reason  for  the  complicated  definition  is  that,  in  terms 
of  the  power  series  representation  for  cosine,  all  odd  terms  are 
missing.  In  order  to  maintain  consistency,  COS(f,n)  must  be 
defined  by  using  n  +  1  terms  (including  the  0  term)  of  the 

series.  This  means  that,  for  n  even,  the  actual  series 

representation  of  COS(f,n)  will  have  n/2  +  1  terms. 

As  usual,  each  grey  value  of  COS(f,n)  is  a  finite  series 
approximation  to  the  cosine  of  the  corresponding  grey  value  of  f. 
Since  cos(z)  is  analytic  in  the  entire  plane,  for  each  (i,j)  in 
the  domain  of  f. 


lim  [COS (f ,n) ]  (i,  j)  »  cos[f(i,j)] 

Example:  Consider  the  image  f  defined  by  f  (0,0)  »  m/2,  f(l,0)  * 

0,  and  f(0,l)  =  1.  Then  the  image  COS(f,5)  is  defined  by 

[COS(f,5)  ]  (0,0)  =1-  (7C/2)2/2  +  (m/2)V24 

[COS (f , 5) ]  (1,0)  -  1  -  0  +  0  -  1 
[COS(f,5)  ]  (0,1)  -  1  -  1/2  -i-  1/24  -  13/24 

As  we  did  for  the  exponential  macro,  consider  COS(f,n)  for 
arbitrary  n.  Then 


lim  (COS (f , n) ) (0,0)  *  0 
lim  (COS (f , n) ) (1,0)  =  1 

n— h* 

lim  (COS  ( f ,  n)  )  (0,1)  -cos(l) 


SIN:  The  situation  for  the  SIN  macro  is  exactly  analogous  to  that 
holding  for  CCS;  however,  in  this  instance,  the  even  terms  of  the 
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power  series  for  sin(z)  are  missing.  As  a  result,  we  define,  for 
even  n  >  0, 

n/2-1 

Sf2k+1 

(-l)k  '(?£  +  "l)  I 

For  n  odd, 

SIN { f , n) 

For  any  (i,j)  in  the  domain  of  f, 

lim  [SIN  (f ,  n)  ]  (i,  j )  =  sin[f(i,j)] 

It  is  important  to  pay  attention  to  the  relation  between  tho 
analytic  macros  EXP,  COS,  and  SIN,  and  the  functions  exponential, 
cosine  and  sine  functions  which  exist  in  whatever  machine  is 
being  employed  for  digital  image  processing.  Let  us  uenoue  these 
machine  functions  by  EXPONENTIAL,  COSINE,  and  SINE,  respectively. 
Each  of  these  machine  functions  is  an  approximation.  For  the 
moment,  suppose  each  is  computed  by  a  truncated  power  series 
expansion  wit.i  a  fixed  number  of  terms,  say  N.  Then  for  any 
image  f  and  for  any  (i,j)  in  the  domain  of  f, 

[EXP (f,N) ] (i, j)  =  EXPONENTIAL [f (i, j) ] , 

[COS ( f , N) ] ( i , j )  -  COSINE[f (i, j) ], 

[SIN  (f , N) ]  (i, j )  «  SINE[f (i, j)]  . 

In  other  words,  the  image  algebra  macro-operators  produce, 
in  a  pixelwise  manner,  the  corresponding  machine  functions.  As  a 
result,  for  a  given  machine,  one  can  define  machine  macros 
accordingly.  These  would  be  written  EXPONENTIAL (f) ,  COSINE(f), 
and  SINE(f),  and  they  would  be  defined  by  the  preceding 
equations.  If  such  an  approach  is  taken,  one  salient  point  must 
be  kept  in  mind: 


<n+l)/2-l 

v  f2k+l 

=  2-  <-!)*  -{Tk  +  1)  ! 

k-0 


[EXPONENTIAL  (f)  ]  (i,  j)  9ief<io> 


since  the  machine  function  is  a  power  series  truncation  defined 
by  the  macro  operator  EXP(f,N).  Moreover,  similar  comments  apply 
to  COSINE  and  SINE. 

Consequently,  there  is  no  macro  operator  e^O)  in  the 
algebra,  nor  can  there  be.  Nor  can  there  be  a  function  ex  in  the 
machine.  As  a  result,  nothing  is  gained  by  employing  the 
symbology  EXPONENTIAL  except  for  a  certain  simplicity  when 

employing  the  macro  EXP(f,N).  Moreover,  the  use  of  such  a  notion 
would  make  the  algebra  machine-dependent,  and  machine  dependency 
would  render  the  entire  structure  less  effective.  Therefore,  we 
shall  not  specify  macros  such  as  EXPONENTIAL. 

Before  leaving  this  section,  an  important  point  concerning 
analytic  macros  should  be  made. 

Suppose  f  is  an  image  for  which  |f(i,j)|  <  1  for  all  (i,j) 
in  the  domain  of  f.  Consider  the  operator  H  defined  by 

H (f )  =  ©  [E{  1 , K (f )  }  ©  f]  . 

For  any  point  (i,j)  in  the  domain  of  f, 

[H  (f )  ]  (i,  j)  -  [1  -  f  (i,  j)]'i 

Now  consider  the  function  H(z)  =  ,  which 

analytic  in  the  open  disk  of  radius  1  in  the  complex  plane, 
function  has  the  power  series  representation 

OO 

H  ( z )  -  2 

k-0 

Hence,  it  induces  the  analytic  macro-operator 

a 

H0(f,n)  -  Z  f* 

k-0 


is 

This 
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Of  particular  interest  is  the  relationship  between  H  and  H0. 

For  any  (i,j)  in  the  domain  of  image  f, 

m 

lim  [H0(f,n)](i,j)  =  X  f (i, j)k 

n-M.  k-0 

-  [1  -  f(ifj)]'1 

-  [H  (f )  ]  (i,  j) 

In  a  pi:-:elwise  sense,  lim  H0(f,n)  *  H(f).  But  this  limit 
relationship  exists  outside  the  algebra!  The  macro  H  depends  only 
upon  the  fact  that  R  is  a  field;  however,  the  pixelwise  limit 
involves  the  topology  of  R. 

More  can  be  said  regarding  the  limit  relationship.  Since 
H(z)  =  '('I - z)  holds  for  |z|  <  1,  the  limit  is  only  good  for 
|f  (i, j)  I  <1.  However,  both  H  and  H0  are  defined  for  all  images. 
Once  again,  the  algebraic  character  of  the  image  algebra  makes 
itself  felt.  H0  and  H  depend  only  upon  the  manner  in  which  the 
field  properties  of  the  range  have  been  induced  into  the  algebra. 
In  fact,  relative  to  the  algebra  itself,  the  notion  of  an 
analytic  macro  is  purely  fictitious.  Indeed,  any  image  sum  of 
the  form 

n 

k-0 

makes  complete  sense.  The  relevance  of  the  analyticity  of  the 
inducing  function  b(z)  manifests  itself  only  outside  the  algebra. 
Nevertheless,  the  formality  of  the  notion  does  not  render  it 
superfluous.  On  the  contrary,  the  situation  is  analogous  to  the 
relationship  between  the  rational  numbers,  which  can  be  expressed 
without  reference  to  the  Dedekind  cut  axiom  (or  some  equivalent 
axiom),  and  the  complete  space  of  real  numbers. 

Note,  moreover,  that  even  going  outside  the  image  algebra. 
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the  notion  of  analyticity  is  only  relevant  to  those  images  whose 
grey  values  remain  within  the  disk  of  convergence. 


5.  MATRIX  TYPE  MACRO-OPERATORS 

In  practice,  one  often  works  with  images  which  possess 
rectangular  domains.  An  image  which  will  be  called  rectangular 
if  its  domain  is  of  the  form  I  x  J,  where  I  consists  of  a  set  of 
n  consecutive  integers,  say  x+1,  ...,  x+n-1  }  and  J  consists 

of  a  set  of  m  consecutive  integers,  say  {  y,  y+1,  .  ..,  y+m-1}  . 
In  order  to  normalize  matrix  operations  in  the  image  algebra,  we 
shall  call  a  rectangular  image  a  matrix  image  if  «  0  and  y  - 

-m  +  1.  The  image  pixels  can  be  viewed  as  m  by  n  matrix,  though 
it  must  be  remembered  that  it  is  still  an  image.  A  matrix  image 

has  the  form 

( f (0,0)  f (1,0)  .  f (n-1,0) 

f  (0, -1)  £(1,-1)  .....  f (n-1, -1 ) 

*  •  • 

•  •  • 

f(l,-m+l)  ....  f(n-l,-m+l)y 

The  intention  here  is  to  embed  the  collection  of  m  by  n  matrices 
into  the  collection  X  of  images  in  a  canonical  fashion.  Using 
this  canonical  injection,  it  will  be  shown  that  the  standard 

operations  on  matrices  can  be  accomplished  within  the  image 
algebra.  In  order  to  simplify  notation,  we  shall  let  F<m,n> 
denote  the  collection  of  all  m  by  n  matrix  images. 

To  begin  with,  it  will  be  shown  that  matrix  multiplication 
can  be  represented  in  terms  of  the  basis.  To  facilitate  matters, 
we  shall  let  R*  denote  the  row  of  n  grid  points  given  by 

R?  =  ( (n, j),  <1, j) ,  ..  (n-1, j)  } 
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Moreover,  CJ  denotes  the  column  of  m  grid  points  given  by 

CJ  -  {(i,D),  (i,-l),...,  ( i , -m+ 1 ) } 

If  f  is  an  element  of  F<m,n>  and  g  is  an  element  of  F<n,r>,  then 
we  define  the  matri:-:  multiplication  of  f  by  g  in  the  usual 
manner.  If  h  denotes  the  matri:-:  product,  then  h  is  an  element  of 
F<m,r>,  and  for  (i,j)  in  the  canonical  m  by  r  rectangular  domain, 

a-1 

h (i,  j )  *  X  f (k, j)g(i,  -k) 

k-0 

One  should  take  care  to  note  that  the  i  determines  the  column  and 
the  j  determines  the  row. 

The  methodology  to  achieve  a  basis  representation  is  quite 
straightforward  since  the  matrix  product  at  (i,j),  h(i,j),  is 

nothing  but  a  dot  product  of  the  jth  row  of  f  with  the  ith  column 
of  g.  To  accomplish  this  end,  we  select  out  the  jth  row  of  f, 
that  selection  being  S( f,R^).  We  also  select  out  the  ith  column 
of  g,  that  selection  being  S( g,Cf) .  The  latter  selection  is 
rotated  90°and  then  translated  so  that  it  has  the  same  domain 
as  S( f,R^)  .  The  dot  product  of  the  resulting  image, 

T[N{S (g,C?)  ),0,-(i-j)  ] 

is  then  taken  with  S  (f,R^).  This  dot  product  gives  the  value 
h(i, j)  .  The  existential  operator  is  then  employed  to  produce  an 
image  with  a  singleton  domain,  {(i,j)}  and  grey  value  h(i,j). 
Tne  outputs  of  the  above  procedure  are  then  added  (by  basis 
addition)  to  produce  the  desired  m  by  r  product  image.  Written 
out,  the  basis  representation  of  matrix  multiplication  is  given 
by 


I 


-»+i 


X  E[D0[S(f,R?),T{N[S(g,C?)],0,-(i-j)}],  {  (i,  j  )  >  ] 

j-0 
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Henceforth,  we  shall  denote  the  matrix  multiplication  macro  by 
f  *g . 


Under  basis  addition,  scalar  multiplication  and  matri:-: 
multiplication,  the  collection  F<n,n>  of  square  matri:-:  images  is 
a  linear  algebra. 


Before  proceeding,  we  note  that,  for  any  matrix  f  in  F<m,n>, 
the  transpose  is  given  by  D(f),  the  diagonal  flip  of  Z. 
Moreover,  we  define  the  identity  of  dimension  n,  In,  by 


I»<i/ j) 


1  if  j  ■  -i 
.0  otherwise 


for  each  (i,j)  in  the  rectangular  grid  defining  the  canonical 
domain  for  F<n,n>. 


We  now  wish  to  demonstrate  that  determinants  of  square 
matrix  images  can  be  found  through  the  use  of  basis  operations. 
For  a  1  by  1,  the  problem  is  trivial.  Suppose  f  is  2  by  2 .  Then 
the  determinant  of  f,  det(f),  is  given  by 

4 

det(f)  -  f  (0,0)f  (1,-1)  -  f  (l,0)f  (0,-1) 

=  G[S(f,  {  (0,0)  })o,o®.  S(f,  {  (1,-1)  }).lfl] 

-  -G[S(f,  {  (1,0)  }U.0©S(f,  {  (0,-1)  }0(1)] 

where  G  is  the  parameter  extractor.  In  general,  for  an  n  by  n 
matrix,  the  determinant  is  given  numerically  by 

det(f)  =  Xsp  f  (0,-p  (0)  )  0  f(l,-p(l))  .  .  . 

P  ©  f  (  (n-1)  ,-p(n-l)  ) 

where : 
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a.  The  summation  is  taken  relative  to  real  number  addition. 

b.  The  summation  is  taken  over  all  permutations  p(k)  of  the 
n  integers  0,  1,  2,  .  ..,  n-1 . 

c.  sp  is  either  +1  or  -1,  depending  on  whether  the 
permutation  p  is  respectively  even  or  odd. 

In  a  direct  generalization  of  the  case  for  a  2  by  2  matrix,  the 
determinant  in  the  n  by  n  case  has  the  basis  representation 

n-l 

&[Is,nS(f,|;k,-p(k))H.wp(k)  ] 

p  k«0 

where : 

a.  The  summation  is  relative  to  basis  addition. 

b.  The  product  is  relative  to  basis  multiplication. 

c.  The  subscript  denotes  translation  in  the  x-direction  by 
-k,  and  in  the  y-direction  by  p(k) . 

It  should  be  noted  that  the  macro-operators  for  matrix 
multiplication  and  the  determinant  are  somewhat  peculiar  in  that 
it  appears  that  they  require  special  types  of  input  images.  In 
the  first  case,  for  f*g,  the  number  of  columns  of  f  must  equal 
the  number  of  rows  g;  moreover,  each  must  be  situated  properly  in 
the  grid.  In  fact,  the  situation  is  no  different  than  for  the 
dot  product  macro  Do,  where  the  two  input  images  must  share  a 
common  domain. 

Regarding  the  determinant,  the  problem  is  a  bit  more 
complicated.  Not  only  must  f  be  an  element  of  F<n,n>,  but  there 
is,  in  reality,  a  different  determinant  macro  for  each  class 
F<n,n>,  since  the  definition  involves  the  dimension  n. 
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Nevertheless,  we  shall  continue  tc  act  as  though  there  were  a 
single  determinant,  det<f),  and  we  will  not  indulge  in  such 
nuances  as  the  writing  of  detn(f). 

Our  next  goal  is  to  achieve  a  basis  representation  for  the 
matrix  multiplicative  inverse  of  a  matrix  image.  We  shall  employ 
the  well-known  adjoint  method.  Consequently,  we  must  develop 
representations  of  the  cofactors.  The  cofactor  operator,  COF, 
requires  three  inputs,  a  matrix  image  f  and  two  integers. 
COF ( f , i , j )  is  (-1 )  i+3  times  the  determinant  obtained  by  deleting 
the  jth  row  and  the  ith  column.  (Once  again,  note  the 
interchanged  roles  of  i  and  j.)  For  convenience,  we  define  four 
sets  of  pixels: 


a . 

B1.J 

=  {0,  1,  . . . ,  i-1}  x  {0, 

—1 ,  •  •  • , 

-j+i} 

b . 

ai.i 

=  { i+1,  i+2 ,  . . . ,  n-1}  x 

{0,  -1, 

. . -j+l} 

c . 

B?.J 

“  {0,  1,  •••/  x— 1}  x  { —  j ' 

■ 

H* 

■> 

1 

l_J. 

1 

K) 

. . . ,  — m+ 1 } 

d. 

Bi.J 

=  {i+1,  i+2,  . . . ,  n-1}  x 

{-j-i,  - 

j-2,  . . . ,  -m+1 } 

A  basis  representation  for  the  cofactor  macro  is  given  by 

COF(£,i,j)  =  (-l)i+i  det  [S(f,Bj,  j)  ©S(f,B?,  3j)  _x.0 

©  S  (  f  r  ,  j)  o,i 

©S(fi,Bj,3U(1] 


Once  the  cofactors  have  been  constructed,  it  is  easy  to 
define  the  adjoint  matrix  of  an  image  in  F<n,n>.  Indeed,  for  f 
in  F<n,n>,  the  adjoint,  ADJ(f),  is  given  by  the  pixelwise 
relation 
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[ADJ (f ) ]  (i, j)  *  COF(f, j,i) 

The  grey  value  of  the  adjoint  image  at  pixel  (i,j),  the  pixel  at 
the  intersection  of  the  ith  column  and  jth  row,  is  given  by  the 
cofactor  which  is  obtained  by  deleting  the  jth  column  and  the  ith 
row.  Recalling  that,  for  an  element  of  F<n,n>,  the  diagonal  flip 
gives  the  transpose,  a  basis  representation  for  the  adjoint  is 
given  by 

n-1  n-1 

ADJ(f)  «  D[£  £  E(COF(f,i,  j)  ,  {  <i,-j)  })  ] 

i-0  j-0 

where  the  summations  are  taken  relative  to  basis  addition. 

The  adjoint  method  for  finding  the  inverse  of  a  matri:-:  can 
now  be  employed.  Assuming  f  to  be  nonsingular,  det(f)  is 
nonzero,  then  the  multiplicative  matrix-:  inverse  of  f  is  given  by 

f"1  “  HiFTFT  ADJ(f) 

Direct  substitution  yields  a  basis  representation. 

Perhaps  the  best  way  to  illustrate  the  foregoing  inverse 
methodology  is  to  work  out  an  example  in  detail.  Let  f  be  the 
following  image: 


f  is  an  element  of  F<3,3>. 

We  first  find  det(f)  by  directly  employing  the  basis 
representation.  There  are  si:-:  permutations  of  (0,  1,  2).  These 


92 


are : 


Pi 

* 

(0, 

U 

2)  , 

with 

Sl 

as 

+  1 

p2 

(0, 

2, 

1)  , 

with 

s2 

= 

-1 

p3 

- 

(1, 

0, 

2), 

with 

S3 

- 

-1 

"  P4 

= 

(1, 

2, 

0), 

with 

s< 

= 

+  1 

Ps 

(2, 

0, 

1)  , 

with 

s5 

- 

+  1 

P€ 

= 

(2, 

1, 

0) , 

with 

- 

-1 

There  are  si:-:  summands  in  the  basis  representation.  The  first  is 
given  by 

Si  [S  (f,  {  (0,0)  })  0<0  ©S(f,  {1,-1} )  _1(1  ©S(f,  {  (2,-2)  })_2f2] 

=  <3  >  ©  <2>  ©  <1>  -  <2> 

where  <  >  denotes  an  image  having  singleton  domain  {(0,0)}  and 
single  grey  value.  The  second  summand  is  given  by 

s2  [S(f,{  (0,0)} )  o,o©  S(f,  {1,-2}  ).lr2®S(f,  {  (2,-1)  }).2(1] 

«  (-1)  [<1>  ©  <1>  0  <1>]  <-l> 

The  third  summand  is  given  by 

s3  [ S  (f,  {  (0,-1)  })0(i©  S(f,{  1,0}).  i,0  ©S(f,  {  (2,-2)  }).2,2] 
=  (-1)  [<2>  ©  <0>  ©  <1>]  *  <0> 

The  fourth  summand  is  given  by 

<2> 

Therefore,  the  basis 


<2>  ©  <1>  ©  <1>  « 

The  fifth  is  <0>  and  the  si:-:th  is  also  <0>. 
sum  over  p:  through  p6  yields  <3>.  Lastly, 
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det  [f  ]  -  Cs [<3>]  -  3 


We  must  now  obtain  the  cofactors.  We  employ  the  following 
sets  in  the  grid: 


Bi,o 

Mt 

0, 

Ho 

-  0,  B lt0  -  0 

Ho 

as 

{  (1,-D  , 

(2,-1),  (1,-2),  (2,-2)} 

Blo 

* 

0, 

Ho 

-  0,  B?>0  -  {  (0,-1),  (0,-2)  } 

B},0 

- 

{(2,-1), 

(2,-2)  } 

BJ,o 

0, 

Ho 

-  0, 

Ho 

Ho 

{ (0,-1) , 

0, 

(0,-2),  (1,-1),  (1,-2),  }, 

H-1 

a 

0, 

*l-i 

-  { (1,0) ,  (2,0)  }, 

*1-1 

=> 

0, 

H-i 

-  { (1,-2) , (2,-2)  }, 

*1-1 

» 

{  (0,0)  }, 

B?,.!  -  {(2,0)} 

*1-1 

* 

{  (0,-2)  }, 

B{,-i  -  {(2,-2)} 

The  remaining  four  collections  of, 

B$,-l  ,  ®$,-2  •  B5,-2  r  and  Bl,-2 

can  be  found  similarly. 

To  find  the  nine  cofactors,  we  directly  employ  the  basis 
representation : 


since 


COF  ( f ,  0, 0)  =  (-1)0+0  det[0©0©0@ 

^  f ,  B8, o  )  -i,i 

*^(f'B8,o  )-i,i  is  given  by 


1 
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COF(f,l,0) 


(-1 )  1+0det  [  0©0©  S  (£,Blr0  >0.1 


©  S(£,BJ,0 

-  (-1)  (2)  -  -2, 


since 


S(£,Blo  )0.x©  *S(f»Bi,0 


)-i,i  is  given  by 


The  remaining  cofactors  can  be  similarly  computed: 


COF(f,2,0)  -  2 

COF(f,0,-l)  -  1 

COF (f f 1/ -1)  -  1 

C0F(f,2,-l)  «  -1 
COF(f,0,-2)  »  -2 
COF (f f lf -2)  -  1 

COF(f,2,-2)  -  2 


Applying  the  existential  operator  and  basis  summing  over  the 
indices  gives  the  cofactor  image: 
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The  adjoint  is  found  by  transposing  (taking  the  diagonal  flip) . 
ADJ(f)  is  given  by: 


A  direct  calculation  shows  that  f*f"x  ■  I3. 

6.  DISCRETE  PICTURE  TRANSFORMS  IN  THE  IMAGE  ALGEBRA 

If  f  is  a  rectangular  image,  then  the  discrete  picture 
transform  involves  a  pre-  and  post -matrix  multiplication  of  f. 
In  order  to  make  this  separate  multiplication  meaningful  in  the 
context  of  the  image  algebra,  some  stipulations  must  be  made. 

In  the  image  algebra,  a  rectangular  image  is  one  which  has  a 
rectangular  domain.  However,  matrix  multiplication  is  only 
defined  for  matrix  images,  those  which  are  elements  of  F<m,n>, 
for  some  m,  n  >  0.  Prior  to  any  matrix  multiplication,  the 

rectangular  image  must  be  translated  so  that  it  is  a  matrix 
image.  Subsequent  to  pre-  and  post-multiplication,  it  can  be 
translated  back  to  its  appropriate  position.  The  original 

translation  must  be  T [f , -i (f ) , - j  (f ) ] ,  where  i(f)  is  the  minimal 
value  of  i  for  which  f  is  defined  and  j(f)  is  the  maximal  value 
of  j  for  which  f  is  defined. 

Any  discrete  picture  transform  requires  two  regular  matrices 
of  a  given  form.  If  the  input  rectangular  matrix  is  of 
dimensions  m  by  n,  then  the  pre-multiplication  matrix  must  be  m 
by  m,  while  the  post-multiplication  matrix  must  be  n  by  n. 
Moreover,  in  order  to  employ  matrix  multiplication  within  the 
image  algebra,  it  is  necessary  to  require  that  the 
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pre-multiplication  matrix,  P,  and  the  post-multiplication  matrix. 
C',  are  elements  of  F<m,m>  and  F<n,n>,  respectively.  This 
requirement  is  merely  formal,  since  the  linear  algebras  F<m,m> 
and  F<n,n>  are  ismorphic  to  the  corresponding  linear  algebras  of 
regular  matrices. 

Given  the  preceding  stipulations,  a  discrete  picture 
transform  on  the  space  of  m  by  n  rectangular  matrices  is  -of  the 
form 


'F(f)  -  {  P  *  f-t  <*) ,- j  <£)  (f)  ,+j  (*) 

As  mentioned  previously,  the  subscripts  denote  translations  to 
and  from  F<m, n>.  They  play  no  role  whatsoever  in  the  actual 
transform  process.  Consequently,  we  will  employ  the  customary 
discrete  picture  transform  methodology: 

'F(f)  -  P*f*Q 

No  generality  is  lost,  since  any  procedure  can  always  begin  with 
a  translation  and  end  with  an  inverse  translation. 

Note  that  the  representation  P*f*Q  is  easily  corrected  to  a 
basis  representation,  since  *  (matrix  multiplication)  possesses  a 
basis  representation.  Consequently,  those  image  processing 
operations  which  are  of  the  discrete  picture  transform  type  are 
within  the  scope  of  the  image  algebra. 

If  it  happens  that  the  pre-multiplication  matrix  P  and  the 
post-  multiplication  matrix  Q  are  nonsingular,  then  the  discrete 
picture  transform  is  invertible;  indeed, 

f  =»  p-i*'P(f)*Q-i 

where,  of  course,  P*1  and  Q"1  denote  the  matrix  multiplicative 
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inverses  of  P  and  Q,  respectively ,  within  the  image  algebra.  In 
other  words,  for  nonsingular  P  and  Q,  ¥(f)  is  invertible  within 
the  image  algebri 

Some  examples  of  the  discrete  picture  transform  will  now  bo 
presented. 


a.  Discrete  Fourier  Transform 

The  discrete  Fourier  transform  (DFT)  results  from  setting 
P  «  F,^  and  Q  «  Fnn,  where  fpp  is  the  p  by  p  image  matrix  with 
grey  values 


Fpp<k,j)  -  £  e*ta*/p]kj 

at  pixel  (k,j),  where  i  denotes  the  imaginary  square  root  of  -1 
and  0  SI  k  £  p-1,  -p+1  £  j  £  0 .  Note  that  we  are  assuming  the 
complex  values  for  pixels  in  the  image  algebra.  Specifically, 

Fpp(k,  j)  -  ^  cos[^fkj]  +  i^  sin[^kj] 

Also  note  that  Fpp(k,  j)  is  not  given  by  the  exponential  to  a 
negative  power.  This  is  because  the  row  number  j  is  already 
negative  in  the  grid  enumeration  scheme.  Now,  for  f  in  F<m,n>, 
the  DFT  is  given  by 

V<f>  -  FTO*f*Fnn 

Since  Fpp  is  nonsingular,  inversion  is  given  by 

f  (f)  -  F&'Vif)*?* 
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b.  Hadamaxd  Tr ana form 

The  Hadamard  transform  results  from  the  discrete  picture 
transform  by  employing  the  Hadamard  matrices  Hjj,  where  Hjj  is 
situated  in  the  space  F<j,j>.  Since  Hjj  is  nonsingular,  we  have 
the  transform  pair 


*  - 


and 

f  -  H&V  {£)**&  - 

Other  commonly  employed  instances  of  the  discrete  picture 
tranform  are  the  Haar  transform,  the  slant  transform  and  the 
discrete  cosine  transform.  All  of  these  are  of  the  form,  P*f*Q, 
with  P  and  Q  nonsingular. 

Prior  to  leaving  this  section,  several  comments  are  in  order 
regarding  transforms  such  as  the  DFT  and  the  discrete  cosine 
transform.  In  the  DFT,  it  is  necessary  to  employ  the  matrix  whose 
terms  are  given  by 


Cw(k,j)  -  |  cos[^kj] 

Assuming  the  irrational  number  rc  to  be  given  by  some  fixed 
rational  approximation,  there  still  exists  the  computation 
problem  relative  to  the  cosine.  Of  course,  we  could  assume  that 
the  function  COSINE  exists  within  the  machine;  however,  as 
demonstrated  earlier,  this  function  can  be  treated  as  a 
particular  case  of  the  analytic  macro-operator  COS(f,N)  for  some 
N.  In  particular,  for  any  value  x, 

cos (x)  -  G [COS (<x>,N) ] , 
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where 


(1)  G  is  the  parameter  extractor. 

(2)  <:•:>  denotes  the  image  with  singleton  domain  {(0,0))  and 
single  grey  value  x. 

(3)  N  is  a  fixed  integer  value  which  corresponds  to  whatever 
power  series  approximation  is  being  employed  to  compute 
the  value  of  the  cosine. 

Similar  comments  apply  to  sin(x)  and  ex,  x  real: 

sin(x)  -  G[C0S (<x>,N) ) 

e*  -  G  [EXP  (<x>,  N) )  . 

As  a  result  of  the  foregoing  considerations,  the  Fourier 
cosine  matrix  Op,  can  be  generated  within  the  image  algebra 
starting  with  the  matrix  image  whose  grey  values  are  given  by 

*  kjr 

for  k  -  0,  1,  ...,  p  -  1  and  j  *0,  1,  . ..,  -p  +  1. 

The  matrix  image  is  given  by 

Cpp  -  p  cos^ipp,*] 

A  similar  relation  holds  for  the  Fourier  sine  matrix.  Moreover, 
if  appropriate  complexification  technicalities  are  taken  into 
account,  the  Fourier  matrix  can  be  written  as 

Fw  -  pEXP  [ 
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One  can  even  go  to  a  lower  level  of  the  algebra  and  consider 
image  matrix  construction  within  the  algebra.  By  this  we  mean 
that,  given  the  integer  p,  a  matrix  of  the  form  could  be 
produced  by  using  image  algebra  operations.  Indeed, 

*pp  -  Z  Z  E[kj,{(k,j)n 

k-0  3-0 


In  other  words,  the  DFT  F^f *FBn  can  bf  looked  upon  as  a 
unary  macro-operator  within  the  image  algebra.  We  can  say  this, 
since  the  dimensions  of  f,  m,  and  n  can  be  found  from  f  by 
staying  within  the  algebra,  and  m  and  n  are  the  only  external 
parameters  required  to  obtain  zm  and  zm. 

7.  BASIS  REPRESENTATION  OF  CONVOLUTION 

In  the  previous  section,  numerous  macros  were  given  in  the 
image  algebra.  Most  of  these  macros  were  simple,  in  that  their 
representations  in  terms  of  the  fundamental  operations  were 
almost  obvious.  In  this  section,  one  of  the  many  more 

sophisticated  image  operations  will  also  be  given  in  terms  of  the 
algebra.  The  crucial  operation  of  convolution  has  been  chosen 
for  this  representation. 

Let  f  and  h  be  images  with  finite  domains;  that  is, 

f,  h  6  Y  ■  U  R* 

AcZxZ 
card  A  <  — 

Recall  that  the  convolution  of  f  and  h  is  denoted  by  f*h.  The 
representation  of  convolution  in  terms  of  the  fundamental 
operations,  and  in  terms  of  previous  macros,  proceeds  in  three 
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steps  : 


a.  First  find  the  180°  rotation  of  h  using  the  macro 

N2;  translate  the  result  by  (i,j),  and  multiply  the 

resulting  image  by  f ,  using  macro  M,  and  then  translate 
again,  this  time  by  (ktn) ,  to  obtain 

uij(k,n)  =  T  (M(T  (N2(h)  ,  i,  j)  ,  f )  ,k,n) 

b.  Next  sum  all  the  uu(k,n)  using  basis  type  addition  (+)  , 
and  then,  from  this  sum,  select  the  image  at  {(i,j)} 
utilizing  the  macro  S.  Call  this  quantity  g^o.  Hence, 

gij  =  S  (  X  u^  (k,n)  ,  {  (i,  j)  }  ) 

k,  n— 

At  any  fixed  pixel,  only  a  finite  number  of  non-empty  images 
u^M^n)  are  involved,  and,  therefore,  convergence  need  not 
be  discussed  for  the  seemingly  infinite  sum  above, 

c.  Finally,  extend  all  the  g together,  using  the  macro  £ 
to  form  the  desired  convolution  f*h: 

f  *  h  *  £  (g00,  £(g°2,  £(g«-i,  ...))) 

Notice  that  only  a  finite  number  of  extension  operations 
need  be  employed  above  because  f  and  h  have  finite  domains.  An 
example  will  be  given  to  illustrate  the  steps  involved.  This 
same  problem  was  given  in  the  following  example. 


Example : 


Let  the  image  f  be  given  by 


102 


and  the  image  h  by 


The  convolution  of  f  and  h  will  now  be  found,  and  each  step  will 
be  illustrated,  utilizing  the  above  images.  Rotate  h  by  180°  and 
let  the  result  be  u: 


Next  multiply  f  and  u  to  obtain  a: 


Find  all  translates  of  a  and  add  them 

•  •  •  ©  «oi  ©  Oio  ©  •  •  •  “  B  -  4 


This  gives  the  image  B  (which  is  identically  equal  to  4 
everywhere) . 


Select  from  B  the  image  g00  consisting  of  the  value  at 
(0,0),  g00  *  S [B,  {  (0, 0)  } ]  .  A  translation  of  the  rotated  image 
given  previously  will  be  performed,  and  many  of  the  steps 
repeated.  So  translate  u  one  unit  to  the  right;  thus 
u10  =  T  (u,  1,0). 


Next,  multiply  f  and  u10  to  obtain  the  image  s,  where 
s  =  M(  f ,  ul0)  : 


2 

1 

0 

8 

8 

0 

1 

2 

Find  all  translates  of  s  and  add  them  together  to  obtain' 

*  •  •  •  CD  ®oi  GD  sio  GD  •  •  • 

Finally,  select  the  image  g10  which  consists  of  the  grey  value  of 

t  at  (1,0)  ;  g10  -  S  [t,  {  (1,0)  }] 


2 

1 

0 

16 

0 

1 

2 

Another  translation  of  the  rotated  image  will  be  conducted  and 
again  many  of  the  steps  will  be  represented.  Translate  u  by  two 
units  to  the  right  to  give  u20:u20  »  T(u,2,0).  Next  multiply  f 
and  u2o  to  get  Y:  Y  -  jW(f,u20) 


2 

1 

0 

16 

0 

1 

2 

3 
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Find  all  translates  of  Y  and  add  them  together  to  give 


d  -  .  ..©  Y  0  Y01@  Y10  0  ...  -  16 


Select  from  d  the  image  g20  made  up  of  the  value  of  d  on  (2,0)  . 
g2o  »  S  (d,  {  ( 2,0)}).  A  large  portion  of  the  procedure  is  again 
repeated.  Translate  u  one  unit  to  the  right  and  one  unit  up: 

uu  =  T(u,l,l)  .  Ne:-:t  multiply  f  and  uxl  to  get  r  *  M( f,uu) 


Find  and  add  all  the  translates  of  r  together  to  obtain 


v  *  ...  r,,.!©  r  ©  r01©  r10  ©  rlx  ©  ...  -  12 
Select  the  image  g11,  consisting  of  the  grey  value  of  v  at  (1,1): 

g11  =  S(v,  { (i,i) }) 


2 

1 

12 

0 

0 

1 

2 

The  procedure 
UqX  *  T  (u,  0 , 1 )  . 

x  -  M( f,Uol) 


is  again  repeated. 
Multiply  f  and  u01 


Translate  u  one  unit  up: 
to  obtain  the  image  X* 
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Find  all  translates  of  and  add  them  together  to  obtain 

y  -  •  •  *  ©  >-  ©  *'*oi  ©  ©  *  •  -  o 

Select  the  image  g01,  consisting  of  the  value  of  y  at  (0,1). 

g01  -  S(y,  {  (0,1)  }) 


IO 

1 

0 

0 

0 

1 

2 

The  procedure  is  repeated  again.  Translate  u  two  units  up:  uo2  * 
T(u,0,2).  Next  multiply  f  and  u02  giving  w:  w  =  M(  f  f  U02) 


Find  all  translates  of  w  and  add  them  together  to  yield  the  image 
0  »  ...©w0wol0  ,,,  -  -1 

Select  the  image  g02  consisting  of  the  grey  value  at  (0,2)  from  0. 

g°2  »  S(B,{  (0,2)  })  . 

The  procedure  is  repeated  for  a  final  time.  Translate  u  two 
units  to  the  right  and  two  units  up.  u22  =  T(u,2,2).  Multiply  f 
and  u22  giving  the  image  d: 


d  =  M(  f,u22) 
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Find  all  translates  of  d  and  add  them  together  to  get 

n  :  H  -  •  •  •  ©  d  ©  do,  ©  .  . .  -  9 

Select  the  image  g22,  consisting  of  the  grey  value  at  (2,2)  from 
T| :  g22  -  S  (T|,  {  (2,2)  })  gives  the  image  g22.  The  last  step  is  to 
e:-:tend  all  g1^  together  to  obtain  the  desired  convolution  of  f 
and  h. 

f  *  h  =  £(g00,  £(g«,  £(g20,  6(g“,  £  (g01,  ....)))) ) 

and  so  on. 

8* CHARACTERIZING  THE  MACRO  OPERATIONS 

The  purpose  of  this  section  is  to  provide  several  ways  of 
categorizing  the  macro  operations.  This  characterization  will 
involve  objective,  as  well  as  subjective,  attributes  of  the 
operations,  in  addition  to  mathematical  and  heuristic  criteria. 
This  characterization  is  useful  for  knowledge  base  systems 
involving  the  imaging  algebras,  as  well  as  for  autonomous  image 
processing  algorithm  development. 

First  and  foremost,  any  macro  operation  can  be  grouped 
according  to  its  arity;  that  is  the  number  of  operands  in  its 
defining  definition.  Further  classification  is  given  by 
specifying  the  type  of  inputs  utilized  and  the  output  sort  which 
results.  For  the  input,  the  order  of  the  operands  is  also  of 
prime  concern. 

Example 

Referring  to  the  previous  sections,  it  is  seen  that  a 
(relational)  data  base  could  be  established  involving  the  above 


type  of  information.  An  instance  of  this  schema  is  given  in 
Table  C-2. 


TABLE  C-2.  OPERATOR  SYNTAX 


Name  of 

Arity 

Domain  Types 

Output 

operator 

operation 

arguments 

12  3 

Sort 

4 

Addition 

(fundaments.1 ) 

0 

2 

image 

image 

- 

image 

Translation 

H 

3 

image 

integer 

integer 

image 

Domain  Finder 

K 

1 

image 

— 

~  — 

subset 

of  ZxZ 

Existential 

E 

2 

real 

subset 

of  ZxZ 

-  - 

image 

Unity  image 

n 

B 

- 

- 

- 

image 

Subtraction 

© 

B 

image 

- 

- 

image 

As  stated 

in  this 

table, 

Addition 

is  a  binary 

operation 

since  its  arity  is  2  with  both  inputs  being  image,  and  with 
output  also  an  image. 

A  polyadic  graph  (Figure  C-5)  is  another  useful  way  of 
representing  the  information  contained  within  the  flat  file 
illustrated  in  Table  C-2.  This  graph  involves  arrows  with  many 
tails  corresponding  to  the  arity  of  the  operator.  The  head  of 
the  arrov;  points  to  the  sort  of  output,  which  is  indicated  by 
using  an  oval  containing  the  type  of  output.  Each  tail  is  also 
attached  to  an  oval  containing  the  sort  of  input  utilized  in  the 
operation.  For  operators  involving  more  than  one  sort  of  input,  a 
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siash  mark  is  given  to  the  tail  to  indicate  the  order  within  the 
operation.  This  is  illustrated  in  Figure  C-5. 

Translation 


Figure  C-5«  Polyadic  Graph 
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Equivalence  classes  of  macro  operations  are  established, 
utilizing  this  recording  system.  The  partitioning  procedure  is 
of  prime  importance  in  syntax  specification  and  program 
correctness . 

A  distinct  way  of  partitioning  and  therefore  characterizing 
these  operations  involves  the  nature  of  the  function.  Every 
operation  described  herein  involves  a  (digital)  image  among  its 
inputs  or  as  an  output.  This  motivates  the  following 
terminology.  A  macro  operation  is  said  to  be  an  image  creation 
macro  or  a  creation  macro  if  only  the  mtput  involves  an  image. 

A  macro  operator  is  said  to  be  an  image  transformation  when  both 
the  output  and  input  involve  images.  Finally,  when  only  the 
input  of  a  macro  involves  an  image,  then  the  macro  is  said  to  be 
a  parameter  determination  macro. 

Example 

The  translation,  rotation  and  division  operations  are  all 
transformation  macros.  The  existential  operation  as  well  as  the 
zero  image  are  image  creation  macros.  Finally,  the  domain  finder 
and  grey  value  determiner  are  both  parameter  determiner  macros. 
In  the  former  case,  the  parameter  is  a  subset  of  ZxZ  and,  in  the 
latter,  it  is  a  real  number. 

As  indicated  above,  parameter  determination  macros  are 
further  broken  down  by  specifying  the  type  of  parameter  which  is 
measured.  In  a  more  arbitrary  fashion,  transformation  macros  are 
further  characterized:  A  transformation  macro  is  said  to  be 
domain  increasing  if  there  exist  image  operands  flf  f2,...,fn  in 
addition  to  other  possible  inputs,  and  for  i  *  l,...,n  the 

cardinality  of  K(fi)  <  cardinality  of  the  output  domain. 

Example 
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The  fundamental  addition  operation  is  a  domain  increasing 
transformation  since 


g 


and  card  g  *  2  >  card  lno,0)>  *  card  0((lfO)). 

The  fundamental  division  tranformation (+) ,  translation  T,  and 
the  subtraction  macroQare  not  increasing. 

In  a  similar  manner,  a  transformation  macro  is  said  to  be 
domain  decreasing  if  there  exist  image  operands  flt f2,  .  .  . ,  fn,  in 
addition  to  other  possible  inputs  (if  any),  such  that,  for  i  ■» 
l,...,n,  the  cardinality  K(fj,)  >  cardinality  of  the  domain  of  the 
output  i  "  1,2, ...,n. 

Example 

The  fundamental  division  operation  is  domain  decreasing 
since  @0;(0(0)|  «  0  and  card  O<(0f0)}  -  1,  whereas  cardinality 
of  0  -  0  Notice  that  the  selection  macro  S  and  the 

addition  macro  are  both  domain  decreasing.  Both  the  fundamental 
operations  wf  translation  and  addition  are  not  domain  decreasing. 

It  should  be  noted  that  there  exist  operations  which  are 
both  domain  increasing  and  domain  descreasing  as  the  following 
example  exemplifies. 

Example 

Consider  the  divide  type  of  macro  Q  where  Q :  X  x  X  — ►  X  and 
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Q(f,  g)  ( ,  y ) 


f (:-:,y) /g(s*y)  g(x,y)  #  0,  <x,y)  «  a  n  b 

£(:•:, y)  y)  «  A  -  B 

1  /  g(x,y>  g(:-:#y)  #  -  C  and  (:*:,  y)  «  B  -  A 

.undefined  otherwise 

with  A  *  K(f)  and  B  ■  K(g)  .  It  follows  tnat 

Q(f,g)  ■  £®(©g)  •  f©g* 

xn  any  case,  using  Q(l{jo,on'^<U.O)))  "  ^uo.o,  a,o)n 


shows  that  Q  is  domain  increasing,  while  Q(0{<o,on»  0{(o,o>>)  *  0 
shows  that  it  is  domain  increasing. 

Another  important  concept  is  that  of  domain  stability.  A 
transformation  macro  is  said  to  be  domain  stable  if  it  is  not 
domain  increasing  or  domain  decreasing.  Specifically,  domain 
stability  means  that,  for  all  possible  sets  of  input  operands 
fi,fa,  .  .  . ,  f «  and  all  other  sets  of  inputs  (if  any),  there  exists 
an  input  image  f*  such  that  cardinality  of  JCff*)  «  cardinality  of 
the  output . 

Example 

Notice  that  the  translation,  rotation  and  flip  operations 
are  all  domain  stable,  as  is  the  scalar  multiplication  macro. 

Two  special  types  of  domain  stable  transformation  macros 
will  now  be  defined.  Both  happen  to  be  illustrated  in  the  above 
example.  The  first  type  of  domain  stable  transformation  is  called 
a  rigid  transformation.  Intuitively,  this  type  of  transformation 
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takes  an  image  in  X  and  only  moves  it  to  yield  another  image  in 
X--n©  operation  on  the  grey  values  is  performed.  Normally  only 
dome  n  induced  operations  are  utilised  in  creating  these  types  of 
operations.  More  rigorously,  Q,  is  a  domain  stable 
transformation  said  to  be  rigid  means  that  Q  is  expressible  as  a 
term  involving  only  the  fundamental  operations  of  translation  T, 
90°  rotation  N  and  diagonal  flip  D;  that  is,  Q  is  definable  under 
function  composition,  utilising  only  the  operations  T,  N,  and  D. 

Example 

Consider  a  transpose  type  operation  Q  on  images,  where 


Q:  X  X  and  Q<f)  (x,y)  »  f  (l-y,2-x)  . 


In  particular,  if 


it  follows  that 

Q(f) 


2 

4 

T 


Furthermore,  Q(f)  -  T(D(f),l,2).  As  a  consequence,  the 

transpose  operation  above  is  a  rigid  transformation. 


The  second  type  of  domain  stable  operation  is  called  domain 
invariant.  It  is  defined  for  operators  requiring  a  single  image 
input  and,  as  the  name  suggests,  this  type  of  transformation 
macro  must  have  an  image  output  whose  domain  equals  the  domain  of 
the  input  image . 
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Example 

Let  us  find  *11  domain  stabla  transformations  which  a r#  at 
the  same  time  rigid  and  domain  invariant.  The  first  thing  to 
notice  is  that,  by  repeatedly  employing  either  D  or  N  to  a  given 
image,  at  most  only  eight  different  images  result  (including  the 
original) .  This  discussion  is  related  to  the  previous 
presentation  on  the  octic  group.  An  instance  of  the  eight 
possibilities  is  given  below  in  figure  C-6. 
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Figure  C-6.  Optic  Group 
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Furthermore,  it  should  be  noticed  that  the  translation 

operation  is  of  no  value  in  mapping  any  of  the  images  in  Figure 

C-6  (excluding  f)  into  an  image  with  the  same  domain  as  f. 

Translations  applied  anywhere  will  yield  images  with  the  same 
basic  shapes  as  those  illustrated  in  Figure  C-6.  This  fo)lows  L 
observing  that  there  always  exists  integers  i  and  j,  such  that 

T(N(T(f,p,q) ) ,  i,  j)  -  N(£), 
and  there  exists  ii  tegers  i',  and  j'  such  that 

T(D(T(f,p,q)),i#,  j')  -  D(f)  . 

This  shows  that  utilisation  of  translation  in  the  midst  of 
employing  D  and  T  will  be  of  no  value;  that  is,  the  only  images 
obtainable  under  function  composition  involving  T,  D  and  N  are 
the  eight  images  depicted  in  Figure  C-6,  aloi  g  with  their 

translates.  It  follows  that  the  only  rigid  domain  invariant 
transformation  macro  is  the  identity  operation  I,  where  1(f) (x,y) 

-  f  (x,y)  . 


The  immediate  discussion  will  be  concluded  by  way  of  an 
example  illustrating  a  domain  stable  transformation  macro  which 
is  neither  domain  invariant  nor  rigid. 

Example 

Consider  the  macro  operation  Q  where  X  — >  X  and  Q(f) (x,y)  - 
2  f ( y , x ) .  Then 


Q(f)  - 


For  instance,  using  f  as  given  in  the  example  yields  the  image. 


Q(f) 


and  so  card  K{f)  =  card  K(Q(f))  which  shows  that  Q  is  a  domain 
stable  transformation.  However,  by  Example,  Q(f)  is  not 
obtainable  as  a  term  from  f  using  N,D  and  T,  and  so  Q  is  not  a 
domain  invariant  transformation,  and  it  certainly  is  not  rigid. 

This  ends  the  example. 

An  additional,  perhaps  obvious,  way  of  characterizing  the 
macro  operation  is  by  name.  Names  are  often  indicative  of 
purpose.  For  instance,  all  addition  type  operations  should  be 
grouped  together.  In  this  grouping,  there  would  appear:  the 
fundamental  addition  operation (+)  ;  the  intersection  type  addition 
macro,  the  Minkowski  addition  operation  E8,  etc.  A  somewhat 
similar  type  of  characterization  would  arise  by  grouping  macros 
according  to  purpose.  It  should  be  mentioned  that  actual 
physical  grouping  is  not  what  is  intended  hero;  rather,  it  is  the 
(logical)  linking  together  of  the  information.  Conventional  data 
base-data  structure  techniques  such  as  linked  lists  or  relational 
structures  could  be  used  for  this  purpose.  Additional  so-called 
AI  techniques  such  as  semantic  net  or  frame  structures  would  also 
be  appropriate.  An  example  of  a  semantic  net  structure 

incorporating  some  of  the  information  illustrated  in  this  section 
is  given  below. 

Example 

Consider  the  transformation  macros,  a,  ©,©  ,  T.  Then  a 
semantic  net  representing  some  properties  of  these  operations  is 
given  in  Figure  C-7 . 
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The  same  information  given  in  the  Example  is  again  provided, 
using  a  relation  data  base  flat  file  in  Table  C-3 .  The  benefit 
of  the  latter  approach  is  immediate. 

Example 

TABLE  C-3.  FUNCTION  TYPE 


Macro  Type  of  Nature  of  Function 

Operation  Operation  Arity  Creation  Transformation  Parameter 

Symbol  Type  Type 


a 

Add 

2 

Decreasing 

- 

© 

Add 

2 

Increasing 

- 

© 

Maximum 

2 

Increasing 

- 

m 

X 

Translate 

3 

Stable-rigid 

- 

Other  types  of  groupings  are  of  equal  importance  to  the  types 
mentioned  above.  For  instance,  grouping  together:  arithmetic 
operations,  or  logical-lattice  type  operations,  or  morphological 
operations,  or  even  data  base-type  operations,  such  as  the 
extension  macro  operation  6  and  the  selection  macro  S. 

9.  MATHEMATICAL  INDUCEMENT  OF  BASIS 
OPERATORS  IN  THE  IMAGING  ALGEBRA 

Earlier,  it  was  mentioned  that  several  of  the  fundamental 
operators  in  the  image  algebra  were  either  range  or  domain 
induced  operations.  However,  these  notions  were  not  defined. 


118 
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In  this  section,  the  meaning  of  range  inducement  will  be 
given  and  illustrated.  This  is  followed  by  the  definition  of 
domain  inducement.  It  will  then  be  shown  that  the  fundamental 
operations  of  translation,  rotation  and  reflection  are  all  domain 
induced. 

It  was  previously  seen  that  one  of  the  principal  reasons  for 
dealing  with  induced  operations  is  the  simplicity  in  which 
polynomial  term  specifications  of  image  processing  operations  and 
algorithms  can  be  determined.  An  additional  reason  for  utilizing 
induced  operations  is  in  variety  specification.  Here  a  very 
important  theorem  is  proven,  showing  that  range  induced 
operations  commute  with  domain  induced  operations.  A  consequence 
of  this  result  is  that  any  of  the  domain  induced  fundamental 
operations  (mentioned  above)  commute  with  any  of  the  other 
fundamental  transformation,  operations. 

The  operator  R  is  said  to  be  range  induced  by  r  if: 

a.  r  is  an  n+k  ary  function  n  I>  l,k  £  0,  with 


r : 

Bn  Bx  .  .  x  Bk 

— »B 

R: 

X  Bk  -4  L^Bh 

HCX 

HCX 

for 

any  ft  in  ^BH, 

i  =  l,2...,n  and  bj  in  B3 

Hex 

j  = 

1 , 2 ,  .  .  .  ,  k 

it  follows  that 

R  (fi,  ^2'  •  •  •  f  bj,  •  •  •  /  (***) 

=  r  (f1  ,  f „(:•:)  ,bx,  .  .  .  ,bk) 

for  all  the  points  where  each  fj.(:-:)  is  defined  at  the  same  time. 
If  every  fi  is  defined  on  the  same  domain;  that  is  fi  €  BA  for  i 


“  1 1 2  ,  • • • t n ,  if 


R  :  (BA) n  L±  Bk  ->  BA 

and  if  R  is  range  induced,  then  ' 

R  (fl  t  ^2!  •  •  •  r  fn'kl'-*-'*  “(bit)  {>•) 

*  (  f  1  ( .*•  )  f  »  »  •  t  f  n  (*• )  /  1  •  *  •  /  ) 

for  every  in  A.  For  the  more  general  case  cited  in  the 
definition,  the  equality  need  only  hold  in  the  intersection  of 
the  domains  of  the  functions  involved.  The  intersection  of  these 
domains  herein  is  called  the  common  region. 

Example 

Notice  that  the  unary  operation  of  subtraction,  r  *  -,  is 
such  that 


-  :  R  — >  R 

As  a  result,  the  macro  subtraction  image  operation  R  **  0  ,  where 

0  :  LJRH  ->  kJRH 

HcZxZ  KCZxZ 

in  the  imaging  algebra  is  range  induced  by  -  ,  since 

[ ©  (f ) ! (u,v)  -  -f (u,v) 

Example 

Consider  the  binary  addition  operation,  r  =*  +, 

+  :  R  x  R  — *  R 
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The  macro  imaging  addition  operation  for  images 
induced  by  +.  This  follows  since 


is  range 


and 


Q,  :  RH  R«  kJ  RH 

HcZxZ  HcZxZ  HcZxZ 


d  ( f,g)  (u,v)  *  f  ( u  /  v )  +  g(u,v) 

for  all  pixels  (u,v)  in  the  intersection  of  the  domain  of  f  and 
g.  Recall  that  a  is  not  defined  elsewhere.  If  the  operator 
happened  to  be  defined  elsewhere  in  an  arbitrary  fashion,  it 
still  would  be  considered  to  be  range  induced. 


Example 


Again  consider  binary  addition  as  in  the  last  example.  The 
fundamental  addition  operation © in  the  algebra  is  also  range 
induced  by  +.  This  follows  since 


and 


©  :  U  RH  x  U  R"  ->  U  R» 

HcZxZ  HCZxZ  HCZxZ 


(f  ©  g)  (U,v)  =■  f(u,v)  +  g  (u,  v) 


for  all  points  in  the  intersection  of  the  domains  K(f)  of  f  and 
K(g)  of  g.  Thus,  the  common  region  here  is  K(f)  n  K(g) .  Recall 
that  (f©g)(u,v)  was  (heurist ically)  defined  as 


©  g)  (u,v)  =  f  (u,  v) 


for  (u,v)  €  K ( f )  -  K(g)  and 

©  g)  (u,v)  -  g  (u,  v) 

for  (u,v)  €  K(g)  -  K(f)  and  was  undefined  elsewhere.  The  way 


©  is  defined  outside  the  common  domain  of  its  operands  f  and  g 
is  irrelevant  to  the  inducement  process. 

In  an  analogous  fashion,  it  follows  that  the  fundamental 
multiplication  operation  ©  is  range  induced  by  the  multiplication 
of  the  reals,  and  the  fundamental  maximum  operation  ©in  the  image 
algebra  is  induced  by  the  maximum  operation  v  in  the  real 
lattice . 

Example 

Consider  the  reciprocal  partial  operation  on  the  reals. 

Here 


■+•  :  Ro  R0 

where  R0  =  (-<*>,  0) u  (0, °o)  .  This  operator  range  induces  a  type 
of  division  operation  B  on  a  subset  of  images  where 

B  :  'vJr8  kjRH 

HCZxZ  0  HCZxZ  0 

Therefore,  S3  only  operates  on  images  which  have  arbitrary 
domains  K(f)  and  no  grey  values  equal  to  zero.  Notice  that 

S(f)  (u,v>  -  twtzy 

for  (u,v)  in  K(f)  and  is  undefined  elsewhere.  Notice  that  the 
fundamental  division  operation  ©  in  the  imaging  algebra  is  an 
extension  of  the  division  operation  0  .  Furthermore,  on 

the  extended  domain  of©  that  is,  for  those  functions  f  in  URH 
which  have  at  least  one  zero  grey  value,  the  operators  B  and© 
provide  the  same  answer  when  applied  to  f  restricted  to  the 
domain  equal  to  the  support  region  of  f.  Because  of  this,  we  say 
that  ©  is  a  support  extended  extension  of  a  range  induced 
operation  induced  by  +. 
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The  function  D,  where 


Di  U  B“  Ax:-: .  .  .  x  A^  Ub« 

<  HCA  HcA 

is  said  to  be  domain  induced  by  the  operation  d  where 

d:  A  Aj_:: -*  A,  if 

D  [f,a1#a2,  .  .  .  ,an'.x]  (:•:)  »  f  [d<:-:, alfa2f  . .  . ,an._x 


Example 

Let  d  be  the  real  vector  type  (binary)  subtraction 
tuples,  thus: 


d:  (Z:-:Z)  (ZxZ)  (ZxZ), 


where 


d((u,v),  (if  j) )  -  (u-i,v-j)  . 


Tv i :  function  induces  (up  to  isomorphism)  the 
opt  tion  of  image  translation;  indeed. 


D 


T,  where  D:  UR" 

HCZxZ 


( ZxZ)  -»  kjRH 

HCZxZ 


Here  n'=  2  and  so 


Ax  -  A  -  ( ZxZ ) 


and  B  =  R.  Thus, 

lyj  R« 

HCZxZ 

is  the  set  of  all  images  described  previously. 


)] 


of  two  vector 


fundamental 


and  the 
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translation  operator  is 


T(f,  (i,  j) )  (u,v)  -  f  (u-i, v- j) 


Example 


Suppose 


d:  { Z::Z )  -»  (Z::2) 


where 


d((u,v))  -  (v,-u) 


Then  d  is  a  (unary)  operation  on  vectors, 
corresponds  to  the  matrix  (rotation)  operation. 

c  •;) 

on  the  column  vector 


Notice  that  n'  ■  1  in  this  case,  and  if  B  ■  R  and 
fundamental  operation  of  counter-clockwise  90' 
induced.  Hence, 


where 


N:  ^Jrh  'sjR8 

He  I  at  Hctxt 


N(f)  (u,v)  «  f  (d (u, v)  )  -  f(v 


Example 

Define  d  in  the  above  example  as 


This  operation 


D  -  N,  then  the 
*  rotation  is 


12H 


d ( (u, v) )  -  (-v,-u) 

Then  this  operation  corresponds  to  the  idempotent  matrix 
operation 

(-!  D 

on  the  column  vector 


The  domain  induces  operation  on  images  is  the  fundamental 
diagonal  flip  operation  D  where 

D(f)  (u,v)  -  f(-v,-u) 

Among  the  numerous  benefits  of  employing  an  algebra  whose 
fundamental  operations  are  induced  is  the  fact  that  range  induced 
and  domain  induced  operators  commute.  The  precise  statement  of 
this  fact  is  given  below  in  Theorem  1.  Utilizing  this  theorem 
along  with  the  commutativity  of  domain  induced  operations  and  the 
extension  operation  provides  more  powerful  theorems  (such  as 
Theorem  1)  on  the  commutativity  of  operators  in  the  image 
algebra . 


If  R  is  a  range  induced  operation  and  D  is  a  domain 
induced  operator,  then  these  operations  commute  on  the  common 
region . 

&anmsn£  l 
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Recall  that  the  common  region  consists  of  all  points  in 
the  intersection  of  the  domains  of  the  function  fi,fj,...,fn 
used  in  range  inducement.  In  the  common  region, 

R  (fl>  f  2'  •  •  •  t  b2,  *  •  •  *  (*■*) 

"  r(fj( k fn( m ), hj,  b* ) 

holds  true.  No  restrictions  are  needed  in  domain  inducement: 
here 

D  ( f ,  a^,  a2,  •  »  •  ,  en'_i)  (>i)  m  f  (d  (x,  a2,  . .  ■ ,  an*„^) 

The  proof  will  be  given  with  the  help  of  the  diagram  (Figure  C-8) 
given  below.  Specifically,  it  will  be  shown  that  this  diagram 
commutes;  that  is,  by  traversing  it  first  to  the  right  and  then 
down  (paths  I, II)  gives  the  same  results  as  if  it  were  traversed 
first  going  down  and  then  to  the  right  (paths  III,  IV) . 


KCZxZ  HCZXZ 


Figure  0-8 .  Commuting  Diagram  of  Domain  and  Range  Commutativity 


When  f*  and  h  are  restricted  to  the  common  region,  we  will  show 
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that  they  are  equal;  that  is,  using 


f  -  R<fx,fa,  • 


*  fnf  bjf  • .  *  t  bfc) 


and 

* 


h  •  D(f,alfaa,  .  . . , an>.x ) 


along  with 


f  *  ”  D ( f^(  a^»  .  .  %  f  an*_i)  i  •  1, 2, . .  .  ,n 


and 


f*  - 


t  ba»  • '  • » ^k) 


we  will  show  that 


-  h(x) 


for  in  the  common  region. 

Praaf ; 

By  traversing  the  diagram  above  along  path  X  and  using  range 
inducement  gives 

f  -  r  (fx(::)  ,  fa(x) ,  .  .  . ,  fn(>:)  fblf  .  .  .  ,bk) 

then  using  path  II  along  with  domain  inducement  yields  the  fact 
that 

h  ”  r  (fa  (d  (sr  alf  .  .  . ,  an'.j) )  ,  .  .  .  *  fn  (d  alf  .  .  . ,  an»_i)  ) ,  blf  .  .  . ,  b^) 
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This,  of  course,  holds  in  the  common  region  mentioned  above. 

Ne::t,  if  the  diagram  is  traversed  first  along  path  1ZI  and 
domain  inducement  is  used  n  times,  then, 

f i  (•■•)  m  f i  (d  (:■», ax, a2, » .  • ,  an*-i ) )  i  •  1,2,  ...  ,n 

Then  traversing  path  IV  and  using  range  inducement  gives 

f*  «  r  (f*  (:•:),  fj  f  *  <oc)  ,bx,  ...  ,bk) 

If,  in  this  expression, 

f*(:-:)  »  fiidUXftx,  .  .  -ra^) ) 

is  substituted,  it  is  seen  that  f*  (x)  -  h(:<),  thereby 

concluding  the  proof. 

Corollary; 

Let  R  be  a  range  induced  operation,  yielding  an  image 
whose  domain  is  the  intersection  of  the  domains  of  its  image 

operands.  If  D  is  a  domain  induced  operator,  then  R  and 
D  commute,,  along  with 

fj  ”  D(fi,a1,...,an'_i)  i  ■  1,2, ...,n 


and 


f *  "  R ( f^,  f 2,  .  .  . ,  f^, blfb2,  •  •  • ,  bk) 


we  will  show  that 


f*(x)  -  h  (:■:) 
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for  in  the  common  region. 

i 

By  traversing  the  diagram  above  along  path  I  and  using  range 
inducement  gives 

f(::)  -  r  <fx  (:•:)  ,  fa  fn(x)  ,bx,  ...  ,b„) 

then  using  path  II  along  with  domain  inducement  yields  the  fact 
that 

h  ( :•: )  -  r  (fxfdfX'*!,  .  .  . ,  an*.x) ) ,  .  . ,  fn  (d  (>:,  ax,  .  .  .  ,an..j.)  ),blr  .  . .  ,bx) 


This,  of  course,  holds  in  the  common  region  mentioned  above. 

example 

If  the  range  induced  operator  It  is  G,  the  add  macro,  then  Cl 
commutes  with  any  domain  induced  image  operator  D.  So,  for 
instance,  a  commutes  with  translation  T,  90°  rotation  N,  and 
reflection  D.  Thus, 

T  (  Cl  <f,g),i,j)  -  Cl  (T  (f ,  i,  j ) ,  T  (g,  i,  j ) )  , 

N (  G  (f , g) )  »  G  (N (f )  ,  N (g)  ) 

and 

D  (  G  (f ,  g) )  -  G  (D(f),  D  (g) ) 

Similar  results  can  be  given  for  the  multiplication  macro  M.  as 
well  as  the  higher  macro  H,  lower  macro  £  and  numerous  other 
macros . 
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One  of  the  immediate  goals  will  be  to  show  that  any  domain 
induced  image  operation  commutes  with  the  fundamental  binary 
range  induced  operators  in  the  image  algebra.  In  order  to  show 
this  result,  it  will  be  shown  that  these  operators  are  comprised 
of  more  trivial  operators,  all  of  which  do  commute  with  any 
domain  induced  operation.  First  it  is  noticed  that  the  three 
fundamental  binary  range  induced  operations  are  representable  as 
terms  using  the  composition  macro  and  certain  other  range  induced 
operations  discussed  in  the  previous  example.  This  result  is 
given  in  Theorem  2 . 

Theorem  2 : 

The  fundamental  operations  of  addition,  multiplication 
and  maximum  have  the  respective  representations: 

f © g  =  e(e  (G  (f,g),f),g) 
f©g  =  E<e  (M  <f,g),f),g) 
f©g  =  E(E  (H  (f,g),f),g) 

The  proof  of  these  representations  follow  directly  from  the 
definition . 

Next  it  will  be  noticed  that  E  commutes  with  any  domain 
induced  operation. 

Theorem  3 : 

If  D  is  any  domain  induced  operation  in  the  image  algebra 
and  C  is  the  composition  operator,  then  these  operations 
commute;  that  is, 

E  (  D  ( f ,  ax ,  a2,  .  .  . ,  )  ,  D  ( g ,  a2 ,  a2 ,  .  .  . ,  an'_2 )  ) 

“  D(E(f,g)  ,ax,a2,  .  .  . ,  a^.^) 
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The  diagram  (Figure  C-9)  below  will  be  shown  to  commute.  Here 
it  is  assumed  that 


f  €  RA  and  g  6  RB  with 

A,B  C  Z:-:Z  and  aA€  Aa,  i  =  1, 2,  .  .  . ,  n'-l . 


Figure  C-9.  Commuting  Diagram 

First,  traversing  this  diagram  from  left  to  right  and  then  down 
gives 

h  =  D(b,a1,a2,  .  .  .  ,  a^)  -  D  (e  (f ,  g) ,  a2,  a2,  .  .  . ,  a.n'.x) 
where 


I  f  ( v )  v  6  A 

e(f,g)  (v)  *  j 

Ig  (v)  v  €  B  -  A 

and  v  denotes  the  two  tuple  (:-:,y).  Using  domain  inducement 
gives 


f  f  (d(v,a1,a2,  .  .  . ,  an'_!)  ) 

if 

d  (v,  ax,  .  .  . ,  an'-i 

h  (v) 

* 

l  g(d(v,a1,a2,  .  .  . ,  aB*.x)  ) 

if 

d  (v,  alf  .  .  . , 

€  A 

€  B  -  A 
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Ne:-:t,  traversing  the  diagram  down  and  then  to  the  right  gives 


p  -  £(l,m)  -  e<D(f,a1,aa,  .  .  ,  an>.x)  ,D  (g,  alf  a2,  .  .  . ,  a,,*.!) )  „ 

Using  the  domain  inducement  gives 

1  ( v )  -  D(£/alfa2r  .  .  .  ,8,..,)  (v)  «  f  (d  (v,  a1#  .  .  . ,  a^) ) 

and 

m(v)  =  D  (g,  ax,  a2,  .  .  . ,  an>.x)  (v)  -  g(d(v,  ax,  .  .  . ,  anMr)  ) 

Therefore, 

p(v)  =  h  (v)  j 

j 

Yhsosem...  4j.  \ 

| 

Any  of  the  binary  range  induced  fundamental  image  operations  I 

commute  with  any  domain  induced  image  operation.  j 

Proof ; 

The  proof  will  be  conducted  for  addition;  the  proof  of  other 
binary  range  induced  operators  are  identical.  It  will  be  shown 
that,  for  any  domain  induced  operation 

D  (f  ©g)  -  D  (f)  ©D  (g) 

I 

By  employing  the  representation  given  in  Theorem  2,  we  have 

D  (f  ©  g)  -D  <e(e«Z(f,g)  ,f)  ,g)  )  " 

* 

Utilizing  the  results  of  Theorem  3  gives  „ 
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D(f©g)  «  £<D<e(0<f,g),f)),D(g>) 


Applying  this  same  theorem  again  gives 

D  (£@g)  =  E(£(D(tf  (f,g)  )  ,D(f)  )  ,D(g)  ) 

Lastly,  apply  Theorem  1  to  obtain 

D  (£©g)  -  E(E(tf  (D(f),D(g)),D(f)),D(g)) 

By  again  using  Theorem  2,  it  is  noticed  that  the  right  hand  side 
of  the  above  expression  is 


D  ( f )  ©D(g) 

thereby  concluding  the  proof. 

This  section  will  be  completed  by  showing  that  the 
fundamental  division  operation  also  commutes  with  any  domain 
induced  image  operation. 

Theorem  ..5.;. 

The  fundamental  image  operation  of  division  ©  commutes 
with  any  domain  induced  image  operator. 


PtQgJL:. 

Let  h  =  ©f  and  let  g  =  D(h,alf  a2, 
Also  let 

b  *  D  (f ,  ax,  .  .  . ,  a.n’-x) 


and 

9*  -©b 


an'-X 


) 
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It  will  be  shown  that  g  *  g*.  Let  f  e  Rx  C  Z::Z,  and  notice 
that 


h  { v)  = 


1/f (v) 


whenever  f (v)  *  0  in  A 


undefined  otherwise 


Here  again,  v  denotes  the  pi:-:el  (::,y).  Therefore, 

fD  (£  (v)"/  ai'  a2/  •  •  .  /  aB»-i)  when  f  (v)  *  0 
g(v)  =  1  elsewhere 

[undefined 

By  using  the  domain  inducement,  we  get 

/  x  |f(dTv7^a2L,  .:■■:>-!))'  when  f  <d(v,alf..  *  0 

g(v)  =  i  elsewhere 

[undefined 

On  the  other  hand,  using  the  domain  inducement  for  b  gives 

b(v)  -  f(d(v,a&,a2,. 

Finally,  using  the  reciprocal  operation  provides  the  desired 
result : 


g*  (v) 


ff  (d(v,"a1,a21,~,a;T.JT  when  f  <d (v, ax, . .  . , an^)  )  *  0 


[undefined 


elsewhere 


10.  ON  THE  VARIETY  07  THE  IMAGE  ALGEBRA 

On  the  various  laws  and  identities  specified  by  equations 
hold  in  the  algebra  developed  herein.  Many  of  these  identities 
occur  due  to  the  inducement  process  as  was  the  case  for  the 
commutativity  of  range  and  domain  induced  operations  seen  in  the 
last  section. 
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Numerous  laws  such  as  the  associative  law,  the  distributive 
law,  and  so  on  are  satisfied  by  various  operators  in  the  algebra. 
As  a  consequence,  numerous  sub-algebras  exist  within  the  image 
algebra.  A  few  obvious  sub-algebras  within  the  image  algebra  will 
be  noted  below. 

Under  the  fundamental  addition©  or  multiplication©,  the 
set  of  all  images  form  a  commutative  monoid.  This  follows  since 
the  equational  constraints  given  ne:*:t  are  satisfied. 

Al)  Associative  Law:  fj_  ©  (£2  ©£3)  =  (fi©fa)  ©  fa 

A2)  Zero  Law:  f©0  -  0©f  =  f  (0  is  the  empty 

image . ) 

A3)  Commutative  Law:  f©g  =  g ©  f 

and 

Ml)  Associative  Law:  fi©(f2©fa)  "  (fi©f2)©fa 
M2)  Identity  Law:  f©0  =  0©f  =  f 
M3)  Commutative  Law:  f  ©  g  *  g©f 

These  structures  are  not  groups,  since  there  is  no  inverse 

operation  for  either  ©  or  ©  . 

There  also  is  a  sub-structure  within  the  imaging  algebra 

which  is  a  join  semi-lattice  with  a  least  element.  This  follows 

by  using  the  set  of  all  images  X  along  with  the  fundamental 

maximum  operation  ©  since  the  following  identities  hold. 


Jl) 

Associativa  Law: 

f  ©  (g  ©  h)  =■  (f©  g)  ©  h 

J2) 

Commutative  Law: 

f  ©  g  -  g©  f 

J3) 

I damp 0 tant  Law: 

f  ©  f  -  f 

J4)  Least  Element  Law:  f  (v)  0  -  f  (0  is  the  empty  image) 

It  obviously  follows  by  symmetry,  using  the  minimum  macro  (a)  , 
that  there  also  exists  a  meet  semi-lattice  with  greatest  element 
within  the  algebra.  However,  it  is  easily  seen  that  (X,  (v)  ©)  ) 
is  not  a  lattice.  This  follows  using  the  counter  example  given 
in  the  following  example . 


Example 

The  absorption  law:  (f  (v)  g)  ®g  =  g  need  not  hold  in  the 
imaging  algebra.  If  f  =  0{<0(0))  and  9  ~  1{<i,o))  then 


(f  ®  g)  ®  g  - 


1 

0 


0 

0 


Many  other  sub-algebras  exist  within  the  image  algebra.  One  very 
rich  structure  is  that  of  a  vector  space.  Specifically,  if  we 
let  VcX=L^Rb,  B  c  ZxZ,  where  V  =  R*,  A  *  0,  then  V  is  a  vector 
space  over  the  reals  where  image  addition:  ©  is  the  vector 
addition  and  the  macro  A  is  the  scalar  multiplication  and  the 
eight  axioms  hold: 

VI)  Associative  Law  For  Vector  Addition: 

x©  (y  ©  *)  *  (:*:©y)©z 

V2)  Identity  For  Vector  Addition:  there  exists  a  unique 
element  0A  in  V  called  the  zero  image,  such  that 

x  ©  (©x  )  “  0*  for  every  image  x. 

V3)  Inverse  For  Vector  Addition:  for  every  x  in  V  there  exists 

a  unique  image  (  ©  :■:)  in  V,  such  that 
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--©  (  ©  »)  *  Ox 

V4)  Commutative  Law  For  Vactor  Addition: 

::©y  -  y  ©  :•: 

V5)  Associativa  Law  for  Scalar  Multiplication: 

ab  A  =  a  A  (b  A  :■:)  (a,b  are  scalar) 

V6)  Identity  for  Scalar  Multiplication: 

1  A  for  every  in  V 

V7)  Distributive  Law  For  Vactor  Addition: 

a  A  ( :•:  ©  y )  -  [a  A  :*:]  ©  [a  A  y] 

V8)  Distributive  Law  For  Scalar  Addition: 

(a©b)  A  -  [a  A  ©  [b  A  x]  (a,b  are  scalar) 

We  will  conclude  this  election  with  another  very  rich 

structure  within  the  image  algebra.  This  structure  involves  two 
domain  induced  operations. 

Consider  any  image  f  along  with  the  fundamental  operations 
of  rotation  N  and  reflection  D.  Let  S  be  the  set  of  all 

images  obtai *  d  by  successively  employing  the  operator  N  and  D  to 
f.  This  structure  is  an  octic  group  with  generator  elements  N 
and  D.  A  graph  of  this  octic  group  is  given  in  Figure  C-6 
involving  image  f  and  macro  operations  N2,N3,V,  F,  and  U. 
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APPENDIX  D 


NAMES  AND  SAMPLES  OF  COLLECTED 
IMAGE  PROCESSING  TRANSFORMS 


1.  IMAGE  PROCESSING  TRANSFORM  NAMES 


Alpha  Conditional  Bisector 
Array  Grammars 
Asynchronous  Interaction 
Background  Subtraction 

Bandwidth  Compression  Via  Iterative  Histogram  Modification 
Bernstein  Polynomial  Approximation 

Best  Plane  Fit  (EPF,  Sobel,  Roberts,  Prewitt,  Gradient) 

Boundary  Finder 

Boundary  Segmenter 

Chain  Code  Angle  Determiner 

Closing  (black  and  white) 

Closure  Operation 
Connection  Operator 
Connectivity  Number 
Convex  Hull 
Convexity  Number 
Convolution  Transform 
Co-occurrence  Matrix 

Cumulative  Angular  Deviant  Fourier  Description 

Cue  Transform 

Digitalization 

Dilation  (black  and  white) 

Directional  Gradient  Transform 
Discrete  Cosine  Transform 
Discrete  Fourier  Transform 
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Discrete  K-L  Feature  Selection 
Discrete  Picture  Tranform 
Edge  Detection  by  Gradient 
Erosion  (black  and  white) 

Fields  Without  Interaction  (black  and  white) 

Fourier  Feature  Normalization 

Fourier  Features 

Frei-Chen  Thresholding  Strategy 

Geometric  Correction 

Gibbs  Ensemble  (black  and  white) 

Gradient  Directed  Segmentation 

Gradient  Edge  Operators 

Grey  Scale  Correction 

Grey  Scale  Histogram 

Grey  Scale  Transformation 

Haar  Transform  (Haar  Functions) 

Hadamard  Transform  (Walsh  Transform) 

Heukel  Edge  Operator 
Hierarchical  Edge  Detection 
Histogram  Equalization 
Hit  and  Miss  Transformation 

Hotelling  Transform  (Karhunen-Loeve  Transform) 
Hough  Method  for  Line  Detection 
Image  Coding  by  DPCM 

Intersection  Function  (black  and  white) 

Kirsch  Operator 

Linear  Erosion 

Linear  Filtering 

Local  Neighborhood  Transform 

L-u  Decomposition 

Magnitude  Gradient  Transform 

Markov  Random  Field  (black  and  white) 

Medial  A>:is  Skeleton 
Minkowski  Functionals 
Moments  of  Silhouette 


Morphological  Covariance 
Noise  Removal  by  Smoothing 
Opening  (black  and  white) 

Farallel  Interactive  Scene  Labeling 
Perimeter  Estimation  by  Dilation 
Planar  Size  Distribution 
Pyramid 

Projection  Estimation  by  Dilation 
Quad  Trees  (and  Binary  Trees) 

Quantization 
Random  Field 
Raster  Tracking 
Region  Growing 
Relaxation  Labeling 

Rotation  Invariant  Field  (black  and  white) 
Sequential  Thinning 
Serial  Relaxation 
Shape  Grammars  ■ 

Simple  Boundary  Segmenter 
Size  Criteria 

Size  Distribution  in  Length 
Skeleton 

Skiz  Transform  (Exoskeleton) 

Slant  Transform 
Spoke  Filter 

Stacked-Image  Data  Structure 

Straight  Line  Detection  by  Linear  Filter 

Subtraction  of  Laplacian 

Superslice 

Superspike 

Syntactic  Noise  Reduction 
Template  Matching 

Template  Matching  by  Cross  Correlation 
Thickening 

Thinning  (Morphological) 
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Thresholding 
Transform  Encoding 
«  Translation  Transform 

Tree  Grammars 

Tree  Search  Labeling  Algorithm 

« 

Umbra  Transform 
Variable  Sized  Hexagons 
Walsh  Feature  Representation 

Zucker  and  Hammel  Three  Dimensional  Edge  Operators 

2.  SAMPLES  OF  THE  IMAGE  PROCESSING  TRANSFORMS 

a.  Beat  Plane  rit  (BPr) 

(1)  Classification; 

Edge  Detection 

(2)  Purpose  and  Methodology; 

The  BPF  technique  is  used  primarily  for  edge  detection.  It 
is  employed  on  digital  images  by  finding  a  plane  which  locally 
best  approximates  this  image.  Local  relative  to  a  pixel  will  be 
a  neighborhood  of  a  pixel;  it  may  consist  of  three,  four  or 
sometimes  more  pixels.  The  criteria  of  Best  will  be  to  minimize 
some  cost  functional  here,  the  Euclidean  Norm.  The  coefficients 
of  the  plane  are  indicative  of  the  presence  of  a  gradient.  This 
is  determined  by  applying  another  functional. 

% 

* 

(3)  Mathematical  Description; 

.  Consider  the  3  x  3  mask,  illustrated  below,  for  finding  the 

gradient  at  the  center  pixel  whose  grey  value  is  x0.  The  grey 
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value  of  the  neighboring  pixels  is  denoted  by  xx, xa#  .  .  .  r::|  and 
are  also  illustrated.  The  absolute  location  of  the  central  pixel 
is  (i, j)  €  ZxZ>  therefore,  its  grey  value  x  (i,j)  «  x0. 
Similarly,  for  the  neighboring  pixels  we  have 

Xj  *'"l 

*'*3  *‘*0  *‘*7 

•  •  M  •  * 

**4  -r,  *'•« 

The  plane  Z  -  ax  +  by  +  c  should  be  fitted  to  the  pixels  under 
consideration.  First  consider  a  four  pixel  fit  where  the  error  e 
is  given  by 

e  «  (ai  +  bj  +  c  -  x0)2  +  (a(i-l)  +  bj  +  c  -  xx)a 

+  (a(i-l)  +  b(j-l)  +  c  -  xa)a  +  (ai  +  b(j-l)  +  c  -  x3)a. 

Minimizing  e  with  respect  to  a,  b  with  c  -  0  gives 


If  the  plane  Z  «  lx  +  my  +  n  were  fit  (using  the  same  type  of 
error  criteria)  to  all  nine  pixels  after  minimization,  we  obtain 


A  weighted  fit  could  also  be  used.  Specifically,  we  could  find 
the  plane 

Z  -  px  +  qy  +  r 

which  is  best  with  respect  to  the  same  criteria  as  above,  but 
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weighs  the  grey  values  xa,x3, x5, x7  by  a  fact  ■:  of  two.  A 
gradient  is  said  to  exist  when  some  functional  (specified  next) 
of  a  and  b,  or  1  and  m,  or  p  and  q  exceeds  a  threshold  value. 
The  most  commonly  employed  functions  are: 

the  lx  norm 

(A  -  I  a |  +  |b|,  B  «  |1|  +  |m| ,  or  C  -  |p|  +  |q|) 
the  la  norm 

(D  »  Vaa  +  ba,  E  -  Vla  +  ma,  or  F  ■  Vpa  +  qa) 
the  1„  norm 

(G  -  max  (|a|,|b|),  H  ■  max ( | 1 | , |m| ) ,  I  -  max  (|p|,|q|)) 

Various  versions  of  the  Roberts,  Prewitt  and  Sobel  gradient 
result  by  application  of  these  different  norms.  This  is 
illustrated  in  the  table  below,  using  Gx  and  Ga,  as  defined  for 
various  templates. 

For  the  Roberts  Template 

Gj.  -  x0  -  x2  and  Ga  •  xx  -  x3 


For  the  Prewitt  and  Sobel  templates 

Gi  "  7+w<:‘:«  +  w:‘:5  +  *c)  “  +  wxi  +  x*) 

Ga  -  7+w(-**«  +  wx7  +  x4)  -  (x2  +  wx3  +  x4) 
with  w  «  1  and  w  ■  2.  respectively  (Table  D-l) . 


Table  D-l .  Gradient  Operators  and  Their  Norm 


RMS  Criteria 

Max  Criteria 

Magnitude 

Roberts : 

D  i 

H  -  max  ( I 1 ,  |Gj|) 

-  1  a  1  +  Ib| 

,  G  - 

?  (IGil-HG,!) 

Prewitts: 

E  -  |  VGi+Gj 

1  H  " 

}  aaxdGJ,  |Gj|) 

1  G  ’ 

?  (IGil  +  IG,!) 

Sobels : 

F  -  f  VGi+G2 

$  aaxdGit.  IG,|) 

2  G  " 

i  ( 1  Gi  1 + 1  Gj  | ) 

Operators  for  this  algebra  involve  the  basis  operations 
previously  described  herein.  The  side  conditions  that  the 
operations  obey  follow  in  a  natural  manner,  since  all  operators 
are  range  or  domain  induced.  However,  this  listing  will  be  given 
as  part  of  the  Phase  II  effort . 


b.  Dilate  (Black  and  Hhite) 

(1)  Classification: 

Primitive  Operation  for  Texture  Analysis  and  Feature 
Generation . 

(2)  Purpose  and  Methodology: 

Dilation  is  the  dual  morphological  operation  of  erosion. 
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Whereas  erosion  is  a  shrinking  transformation,  dilation  is 
expanding. 

(3)  Mathematical  Description: 

Let  X  c  Z:-:Z  and  define 

Db  ( )  =  {(ZlfZa)  €  Z::Z:  (B  +  (ZlfZ2)>  n  X  *  0 
If  we  define  the  Minkowski  Addition  as 

X©B  -  (X=0B)  = 

where  Xc  denotes  the  complement  of  X,  then  we.  have 

Db  (X)  -  X©B 

It  is  important  to  note  that  dilation  is  the  dual  of  erosion  in 
the  sense  that: 


db(X)  =  [Eb  (Xc)  ]  c 

(4)  Transformation  Type: 

Image  to  Image 
Increasing 

Invariant  under  Translation 

(5)  Effectiveness  and  Deficiencies: 

Comments  analogous  to  those  for  erosion  can  be  made.  In 
particular,  for  the  Euclidean  counterpart:  If  4*  is  an  increasing, 
translation  invariant  mapping  on  the  power  set  of  RxR,  then  4*  is 
an  intersection  of  dilations. 

In  fact, 
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A 

4*  (A)  -  O  A  ©  B 
Be  v* 

where  V*  is  the  kernel  of  the  dual  mapping  *P*,  which  is  defined 

by 


4>*(A)  =  [4MAC)]  = 

Note  that,  although  we  have  quoted  this  theorem  of  Matheron, 
together  with  its  erosion  counterpart,  for  Euclidean  images, 
corresponding  results  do  hold  for  Z:-:Z . 

(6)  Alternate: 

Miller' 3  E:-:pand  Transformation 

(7)  References: 

Serra,  p.  43. 

Matheron,  pp .  17,  221. 

Miller,  p.  16. 

Watson,  p.  4. 


c.  Discrete  Fourier  Transform 

(1)  Classification: 

Image  Transformation 

(2)  Purpose  and  Methodology: 

The  Discrete  Fourier  Transform  (DFT)  is  one  of  the  most  used 
transformations  on  images  and  is  utilized  in  almost  all  facets  of 
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imaging,  such  as  image  restoration,  enhancement,  segmentation, 
etc.  It  is  often  employed  as  an  approximation  to  the  actual 
Fourier  Transform  operation  for  continuous  images.  It  is 
described  herewithin  as  an  exact  transform  operating  on  an  image 
f  given  as  an  M  by  N  matrix  of  complex  numbers.  In  particular, 
it  is  specified  below  as  a  special  type  of  Discrete  Picture 
Transform . 

(3)  Mathematical  Description: 

In  the  context  of  Discrete  Picture  Transform  D,  D:  A  — >  A 

with  D(f)  =  F  =  P*f*Q.  The  DFT  F  of  f  is  obtained  if  one  uses 

1 

P  =  and  Q  =  Li„,  with  LJa.  =  je'1 3  rn,n  =  0,1,2,... ,  J-l . 

The  inverse  operator  D_1(F)  *  f  is  called  the  inverse  DFT.  An 
element  of  F  is  given  by 

M-l  N-l 

F(u,v)  =  X  f(m,n)  e-Cin<!^  +  ¥)l 

■-0  n-0 

u  =  0, 1, 2, . . . ,M-1  and  v=0, 1, 2, . . . ,N-1 . 

The  function  F  can  be  extended  to  F, ‘which  is  doubly 
periodic  and  defined  over  ZxZ,  and  is  such  that 

F”(u,-v)  =  F(u,N-v) 

F(-u,v)  =  F(M-u,v) 

F(-u,-v)  =  F (M-u, N-v) 


or,  more  succinctly 

F(aM  +  u,  bN  +  v)  =  F(u,v) 

a,b  €  Z.  Using  the  fact  that  P  and  Q  are  invertible,  similar 
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properties  on  the  original  image  f  can  be  derived.  The  periodic 
extension  property  described  above  is  one  key  in  deriving 
important  consequences  of  the  DFT  for  convolving  images. 

(4)  Transformation  Type: 

Image  to  image 

(5)  Effectiveness  and  Deficiencies*. 

The  DFT  is  one  of  the  key  transform  techniques  in  digital 
image  processing;  however,  a  large  amount  of  computation  must  be 
performed  to  perform  the  transformation.  This  is  because  complex 
values  and  exponentials  are  needed.  A  further  shortcoming  is 
that  when  the  DFT  is  employed  as  a  numerical  approximation  to  the 
True  Fourier  Transform.  (Some  type  of  error  or  bounds  on  the 
error  must  be  registered.) 

(6)  Alternate  Versions: 

Various  fast  versions  of  the  DFT  exist  under  the  global  name 
Fast  Fourier  Transform  of  FFT.  Some  transforms  exist  which 
provide  the  same  or  similar  results  as  the  DFT,  along  with  error 
bounds  for  use  in  approximation.  One  such  algorithm  is  the 
Accurate  Fourier  Transform  AFT. 

(7)  References: 

E.  Hall,  pp.  123-138. 

A.  Rosenfeld  and  A.  Kak  pp.  20-24. 

R.  Bracewell  pp.  376-384. 
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d.  Discrete  Picture  Transform 

(1)  Classification: 

General  Linear  Image  Transformation  Schema 

(2)  Purpose  and  Methodology: 

The  purpose  of  this  general  transform  is  to  provide  a  global 
common  setting  for  numerous  important  image  processing 
transforms.  The  Discrete  Picture  Transform  is  defined  for  image 
f,  given  by  a  complex  valued  M  N  matrix  where 

f  f (0,0)  f  (0, 1)  ...  f (0,N-1) 

f (1,0) 

f  -  ! 

k  f(M-l,0)  ...  f (M-l , N-l ) 

Let  A  denote  the  set  of  all  such  matrices.  The  entries  of  this 
matrix  are  often  real  and  denote  grey  values  of  f  at  designated 
points.  The  transform  is  defined  as  a  linear  operation  on 
images . 

(3)  Mathematical  Description: 

The  Discrete  Picture  Transform  D  is  defined  by:  D  :  A  — »  A, 
where  D(f)  =  F  «  P«f«Q,  where  P  and  Q  are  nonsingular, 
complex-valued  M  x  M  and  N  x  N  matrices  respectively,  and  are  not 
functions  of  the  image  being  transformed.  Specific  transforms 
arise  by  the  way  values  are  given  for  P  and  Q.  The  transforms 
are  often  called  separable,  since  P  operates  on  the  columns  and  Q 
on  the  rows  of  f.  The  entries  of  the  M  x  N  matrix  F  are  given  by 


M-l  N-l 

F(u,v)  -  X  X  P(u,m)  f  (m,n)fc(n,v) 

M-0  t-0 

u  =  0,1,...,  M-l 

v  »  0,1,..., N-l 

By  pre-multiplying  F  =  P*f«Q  on  the  left  by  the  inverse  matrix 
P_1  of  P  and  post  multiplying  the  expression  by  Q-1,  we  obtain 

f  -  P-l  F  Q-i 

We  call  this  transform  which  takes  the  image  F  back  into  f  the 
Inverse  Picture  Transform  and  denote  this  by 

D"1  :  A  — »  A  where  D'l  (F)  -  P'1  (F)  Q"1 

(4)  Transform  Type: 

Image  to  Image . 

(5)  Effectiveness  and  Deficiencies : 

Numerous  Image  transform  techniques,  such  as  the  Hadamard  or 
the  Discrete  Fourier  Transform  are  representable,  using  this 
schema.  The  Discrete  Picture  Transform  is  a  Linear  Operation, 
viz,  for  any  fx,f2in  A  and  complex  number  a,  D  (afx  +  f2)  ■  a 
D(fx)  +  D(f2).  As  a'  consequence,  nonlinear  operations  on  images 
cannot  be  employed  using  this  schema. 

(6)  Alternate  Versions: 

Matrices  could  be  labeled  using  different  indices.  More 
importantly,  the  Discrete  Picture  Transform  could  be  viewed  as  a 
special  case  of  more  general  nonlinear  transforms.  An  instance 
would  be  the  Affine  Transform 
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Cl,  where  Cl:  A  — ¥  A  and  (f)  «  P*f*Q  +  Q0  ■  F 

for  some  Q0  in  A. 

Here,  the  Inverse  Affine  Transform  is  such  that 

Cl -1  :  A  — ►  A  and  Q-i  (F)  -  P-i[<F)  -  QolQ'1 
(7)  References: 

A.  Rosenfeld  and  A.  Kak  pp.  19-20. 


e.  Erosion  (Black  and  White) 

(1)  Classification: 

Primitive  Operation  for  Texture  Analysis  and  Feature 
Generation. 

(2)  Purpose  and  Methodology: 

Erosion  is  one  of  the  two  basic  morphological  operations. 
Its  power  lies  in  the  multitude  of  higher  level  operations  it 
generates  by  the  use  of  different  structuring  elements  and  by 
iteration.  Essentially,  it  operates  by  fitting  small 
structuring  elements,  usually  convex,  into  a  given  black  and 
white  figure. 

(3)  Mathematical  Description: 

An  image  F:  ZxZ  — »  (0,  1}  is  equivalent  to  a  set  X  C  ZxZ, 
i.e.  F  is  the  characteristic  function  of  X  For  B  c  ZxZ,  we  define 
EB(X)  =  {(Zl,Z2)e  ZxZ:  B  +  (Z1,Z2)  c  X}  .  If  we  define  the 
Minkowski  Subtraction  as 
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then  we  have 


xQb - n  x+b 

b«a 

eb(X)  -  xQb 

where 

B  -  {  -  b  :  b  6  B } 

(4)  Transformation  Type: 

Image  to  Image 

Increasing 

Invariant  under  Translation 

(5)  Effectiveness  and  Deficiencies: 

In  the  present  form,  the  transformation  is  limited  to  black 
and  white  images.  Nonetheless,  its  power  is  significant.  To 
emphasize  its  power,  we  note  a  result  from  its  Euclidean 
counterpart,  which  operates  on  images  R  R  — >{0,1}.  If  *F  is  an 
increasing,  translation  invariant  mapping  on  the  power  set  of  R 
R,  then  is  a  union  of  erosions.  In  particular 

'F  (A)  »  LA©  5 
»«v 

where 

V  =  {X  C  RxR  :  0  €  'F  (:•:)} 

V  being  called  the  kernel  of  'F. 


In  practice,  successive  erosions,  each  followed  by  a  measurement, 
generate  morphological  feature  criteria  which  quantitatively 
describe  textural  aspects  of  the  image. 

(6)  Alternate: 

(a)  Miller  defines  the  Shrink  Transformation 

in  terms  of  his  general  neighborhood  transformations. 

(b)  Erosion  operators  can  be  defined  for 
discrete  level  grey-tone  images. 

(7)  References: 

Serra,  p.  43. 

Matheron,  pp.  17,  221. 

Miller,  p.  13. 

Watson,  p.  6. 


f .  Hadamard  Transform  (Walsh  Transform) 

(1)  Classification: 

Image  Transformation 

(2)  Purpose  &  Methodology; 

The  Hadamard  Transform  is  employed  in  numerous  areas  of 
image  processing,  such  as  image  restoration,  enhancement, 
compression,  segmentation,  classification,  etc.  It  is  defined 
below  as  a  special  case  of  the  Discrete  Picture  Transform. 

(3)  Mathematical  Description: 

Consider  the  Discrete  Picture  Transform  D,  D:  A  — >A,  where 
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D(f)  -  F  -  P*f*Q,  and  P  and  Q  are  Hadamard  matrices.  Then  D  is 
called  a  Hadamard  Transform.  A  Hadamard  matrix  Hwis  a  symmetric 
J  J  matrix  consisting  of  l's  and  -l's#  such  that  all  rows 
(columns)  are  mutually  orthogonal#  using  the  Euclidean  inner  or 
dot  product.  The  values  of  J  employed  here  will  be  a  power  of  2, 
i.e.,  J  *  2n  for  n  *  1#  2,....  Furthermore#  it  is  known  that  if 
a  Hadamard  matrix  of  rank  n  >  2  exists#  then  n  ■  4m,  where  m  is 
an  integer.  Thus#  the  first  interesting  Hadamard  matrix  is  H22, 
where 


3y  using  the  Theorem:  If  Hjj  is  Hadamard,  then 

u  Hjj 

h2j2j  -  -h0 

is  Hadamard,  numerous  other  Hadamard  matrices  can  be  found.  From 
F  =  Hmm  f  Hnh,  we  have  the  inverse  relation 

f  -  m  H*  fh^ 

(4)  Transformation  Type: 

Image  to  Image 

(5)  Effectiveness  and  Deficiencies: 

Due  to  the  nature  of  the  P  and  Q  mat  r 1  no  multiples  are 
needed  in  determining  the  Hadamard  Transform;  only  additions  and 
subtractions  of  the  grey  values  must  be  employed.  This  is  a  very 
computationally  efficient  transform. 


(6)  Alternate  Versions: 


There  are  faster  versions  of  the  Hadamarci  Transform.  The 
Walsh  Functions  can  be  used  to  provide  a  transform  equivalent  to 
the  Hadamard  Transform. 

(7)  References: 

A.  Rosenfeld  and  A.  Kak  pp.  24-28. 


g.  Hotelling  Transform  Karhunen-Loeve  Transform 

(1)  Classification: 


Image  Coding 


(2)  Purpose  and  Methodology: 


This  image  processing  procedure  is  useful  in  numerous 
applications  of  image  processing,  e.g.,  image  compression, 
restoration,  enhancement,  rotation,  feature  selection,  etc. 
All  these  applications  are  based  on  minimum  variance 
estimation  criteria  employed  in  deriving  the  Hotelling 
Transform.  The  Hotelling  Transform  is  a  nonlinear 

operation  on  images  and,  as  a  consequence,  is  not  a  Discrete 
Picture  Transform.  Consider  an  f  (i.e.  a  M  by  N  matri:-:  of  reals) 


f 


V 


where  f'  is  ?  1  by  N  vector  denoting  the  ith  row  of  f,  and  the 
prime  denotes  transpose.  Represent  this  image  as  an  M* N  by  1 
column  vector  i.e.. 
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f 


*1 

fa 


V  f*  J 


The  Hotelling  Transform  of  x  (or,  equivalently,  of  the  image  f 
represented  as  a  linear  list  :•:)  is 


y  ■  Ax  +  Q0 

where  A  is  a  J  by  N*M  matrix  described  below,  and  Q0  is  a 
1  vector  1  £  J  £  NM.  This  transform  appears  to  be  Affine; 

however,  this,  too,  is  not  the  case,  for  in  practice  A  and  Q0  are 
complicated  functions  of  x  (or  f) .  The  matrices  A  and  Q0  involve 
moments  from  x  where  x  is  viewed  as  a  random  vector. 


(3)  Mathematical  Description: 


Consider  K  (>  1)  M  by  N  real  valued  images  fx,  f2,  .  .  . ,  fk. 

Let  the  K  column  vectors  xlrx2#  ...,xk  be  the  linear  list 
representation  of  these  images  as  described  above.  Assume  that  x 
is  an  M  N  by  1  random  vector  and  the  probability  that  x  equals  sA, 
is  1/K,  i.e.  P  (x  *  x4)  -  1/K,  i  ■  1,2,...,  It.  Thus  all  the  x4  are 
equilikely  realizations  of  x.  As  usual,  let  x  denote  the  average 
or  mean  vector  and  so 


K 


i-1 


Also,  let  R  be  the  covariance  matrix  for  the  process 

R  -  £  X  (X,  -  )  (x4  -  x  )' 

i-l 

We  will  assume  that  R  is  full  rank.  Since  R  is  symmetric  and 
real,  all  the  eigenvalues  are  real  and  there  is  a  internormal 
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basis  of  associated  eigenvectors.  Let  Aj  be  the  matrix  whose 
rows  consist  of  the  normal: zed  eigenvectors  corresponding  to  the 
«  J  largest  eigenvalues.  The  integer  J  is  a  parameter  here  and 
different  Hotelling  Transforms  are  defined  as  a  consequence.  We 
have  as  the  Hotelling  Transform 

yj  «  Aj(x  -  x  )  *  AjX  -  A,x 

It  should  be  noted  that  ya  is  a  random  vector;  furthermore,  for 
J  «  N  •  M,  we  use  ■  A  and  yj  “  y 
Thus,  in  this  case,  we  have 

y  -  Ax  -  Ax 

This  M*N  by  1  vector  y  could  be  interpreted  as  an  image  g.  To 
see  this,  we  represent  y  as  a  M  by  N  vector 

( £* 

^2 

y  - 

where  each  g*.  is  an  N  x  1  column  vector.  Then  the  image  g 
is  given  by 


* 

9 
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(4)  Transformation  Type: 


Image  to  Image 
Image  to  Vector 

(5)  Effectiveness  and  Deficiencies: 

The  Hotelling  Transform  utilizes  orthonormal  bases  and 
therefore  is  distance  preserving.  It  is  derived  by  minimizing  a 
mean  square  type  error,  and,  therefore,  it  is  optimal  under  this 
cost  function.  The  calculations  involved  in  producing  these 
transforms  are  computationally  complex.  The  procedure  described 
above  was  exact .  Often  one  performs  this  procedure  using 
::2,  .  .  . ,  ::k  as  samples  from  a  (larger)  population.  In  this  case 

=*  E  (>:) 


and 

R  -  E[(x  -  7:  )  (>:  -  x'  )  } 

should  be  employed,  and  the  values  of  x  and  R  given  in  the 
Mathematical  Description  are  statistics  and  therefore  only 
approximations  to  the  true  parameters  x  and  R. 

(6)  Alternate  Versions: 

Numerous  versions  exist,  although  none  which  are  fast.  They 
are  recognized  under  the  following  names: 

Discrete  Karhunen-Loeve  Transforms,  Principal  Component 
Transforms  and  Eigenvector  Transforms.  Some  of  these  methods  do 
not  utilitize  the  term  Q0  -  Aj  x 

(7)  References: 

M.  Kendall  and  A  Stuart  pp .  292-323. 


158 


pp.  271-283. 


E.  Hall,  pp. 115-122. 

J.  Tow,  R.  Gonzalez, 

h.  Opening  (Black  and  White) 

(1)  Classification: 

Feature  Generation  and  Filtering,  Size  and  Shape 

Description . 

(2)  Purpose  and  Methodology: 

The  opening  is  essentially  a  fitting  operation.  The 
opening  of  a  domain  X  is  the  region  swept  out  by  the  translates 
of  the  structuring  element  B.  It  smooths  the  contours  of  X, 
eliminates  negligible  components,  and  suppresses  narrow  dendritic 
extensions.  Iterations  of  openings  play  a  crucial  role  in 
generating  size  and  shape  descriptors. 

(3)  Mathematical  Description: 

For  a  structuring  element  B  and  X  c  Z>:Z,  we  define  the 

opening  of  X  by  B  to  be: 


XB  -  (X0B)  ©B. 

Equivalently, 

XB  =  [B  +  y  :  B  +  y  CX] 

(4)  Transformation  Type: 

Image  to  Image 
Increasing, 

Anti-extensive:  XB  C  X 
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Idempotent : 


(XB)B  =  XB 


;5)  Effectiveness 


If  we  consider  the 
operation, 


and  Deficiencies: 
typical  morphological 


feature  description 


Image  — >  Image  — >  Parameter, 

the  application  of  successive  openings  at  the  Image  — >  Image  stage 
is  determined  by  the  function  of  the  parametric  measurement.  For 
example,  if  we  open  by  ever  larger  sets  of  a  particular  class, 
more  and  more  resolution  of  the  micro-texture  will  be  filtered. 
It  is  precisely  the  measurement  of  the  filtered  micro-texture 
which  is  descriptive  of  size  and  shape.  The  effectiveness  of  the 
opening,  or  its  non-effectiveness,  is  thereby  determined,  at 
least  insofar  as  any  particular  application  is  concerned. 

It  should  be  noted  that  openings  characterize  an  important 
class  of  morphological  mappings  (on  Euclidean  Images) :  If  'P  is 
translation  invariant,  increasing,  anti-extensive  and  idempotent, 

4/:  p(R  x  R)  — >  p(R  x  R), 

then  there  exists  a  class  B0  c  p(R  x  R)  such  that 

'P(A)  =  U{Ab  :  B  e  B0  } 

and  conversely,  where  we  let  p(R  x  R)  denote  the  power  set. 

(6)  Alternate: 

(7)  References: 

Serra,  p.  50. 
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Matherson,  pp .  18,  190. 

Watson,  ,-p.  6. 

i.  Size  Criteria 

(1)  Classif ication : 

Size  (and  ipso  facto  shape)  criteria-general  analysis. 

(2)  Purpose  and  Methodology: 

The  purpose  of  any  given  size  criteria  is  to  create  a 
distribution  associated  with  the  image  which  reflects  its  size 
and  shape  characteristics,  from  a  textural  level.  The  methodology 
is  as  follows: 

(a)  Every  operator  A  will  denote  a  parametized  family 
of  operators  A^,  each  of  the  following  form: 

A*  -  •  4\,  X  >  0 

where 

JX 

(0,1)***  ->  {0,1}*»*  -4  R 

The  family  {4\}  will  be  a  granulometry  (see  (b)  ) 
and  |i  will  usually  be  a  Minkowski  functional. 

(b)  A  granulometry  (4\)  on  the  power  set  of  Z  Z  must 
satisfy : 

(1)  4\(A)  C  A  for  all  A 

(2)  A  C  B  ->  4\<A)  C4\(B) 

(3)  4V  K\i>  0 
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The  following  theorem  of  Matheron  is  important  in  this 
regard : 


X  >  0  is  a  granulometry  iff 

1.  VX  >  O/'Fx  is  increasing,  idempotent  and  anti-extensive, 
and, 

2.  X  >  }l  >  0  implies  B^cB^,  where 
Bx  denotes  the  class  of  . 

3.  In  morphology,  one  usually  digitalizes  by 

utilizing  a  hexagonal  grid.  It  is  important  to  keep 
this  in  mind  when  discussing  directions.  Of 

course,  the  digital  theory  is  applicable  to  Z  Z  in 
general,  and,  hence  square  grids  in  particular. 

(3)  Mathematical  Description: 

Depends  on  particular  granulometry  and  particular  measure. 

(4)  Transformation  Type: 

Image  to  Real 

Image  to  Distribution 

(5)  Effectiveness  and  Deficiencies: 

Effectiveness  depends  upon  particular  operator  and  the  goal 
desired.  In  all  cases,  the  choice  of  the  structuring  element  is 
crucial.  Moreover,  interpretation  depends  upon  expertise.  It  is 
here  when  an  expert  system  would  be  of  fundamental  importance. 

(6)  Alternate: 

(7)  Reference: 
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Mat her on,  pp.  24,  192. 


j .  Thresholding 

(1)  Classification: 

Segmentation 

(2)  Purpose  and  Methodology: 

In  thresholding,  a  figure,  or  an  interesting  feature,  within 
an  image  is  separated  out  from  the  image  by  the  production  of  a 
new  image  in  which  the  figure  is  black  and  its  background  is 
white.  Variants  of  this  methodology  consist  of  whiting  out  or 
blackening  only  portions  of  the  image,  while  leaving  other  grey 
levels  intact. 

(3)  Mathematical  Description: 

In  general,  a  thresholded  image  X  results  from  an  original 
image  X  by: 


1  if  X (i, j)  6  a 

X*  (i,  j)  -  i 

l  0  if  X (i, j)  «  A 

where  a  is  some  subset  of  the  grey  scale.  In  particular, 
thresholding  is  usually  defined  in  the  case  where 

A  -  {  Z:Z  2  X  ) 

In  this  instance,  we  defined 

if  X  (i,  j)  <  X 
if  X  (i,  j)  2:  X 


(if  j ) 
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Whereas,  in  thresholding  proper. 


X€rzxz  xAe{0,l}z-*z 

in  semi-thresholding, 

X€  RZxZ  XA«  RZxZ 

where  the  actual  portion  of  the  grey-scale  (A)  Utilized  is  reduced 
via 

(if  j) 

Xx  (if  j)  -  , 

0 

For  a  simple  threshold,  X,  selection  is  crucial  if  the  object 

is  to  be  clearly  delineated.  Very  often  a  strongly  bimodal 
* 

histogram  indicates  a  sharp  ’figure  and  ground  distinction; 
however,  this  is  certainly  not  always  the  case.  Therefore,  the 
typical  method  of  choosing  between  the  modes  must  be  determined 
judiciously . 

(4)  Transformation/Type: 

Image  to  Image 
Usually:  RZxZ  -»  {0,l}ZxZ 

(5)  Effectiveness  and  Deficiencies: 

As  has  been  hinted  above,  figure  extraction  -by  bimodal 
thresholding  is  problematic.  One  need  only  consider  the 
instances  of  shadows  or  high  frequency  salt-and-pepper  noise.  In 
many  instances,  feature  or  figure  extraction  may  require 
pre-processing;  i.e., 


if  X (i, j)  6  a 
if  X  (i, j)  e  a 
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X  e  R2*2  ->  X  €  R2xZ— »  XK  €  {0,1}2»* 

A  typical  instance  might  be  noise  reduction  by  smoothing, 
followed  by  thresholding  to  separate  the  figure  from  the  ground. 
In  any  event,  the  choice  of  threshold  is  the  most  crucial  aspect 
of  thresholding  and  several  methods,  including  bimodal  selection, 
are  -available.  Should  the  threshold  value  X  be  too  small  or  too 
high,  a  noisy  image  will  likely  result. 

One  possibility  for  threshold  selection  is  local 
thresholding.  For  example,  one  portion  of  an  image  might  be 
lighter  than  another.  In  this  case,  no  single  value  for  X  would 
do.  It  may  be  possible  to  partition  the  image,  threshold 
locally,  and  then  smooth  the  resulting  thresholded  and 
partitioned  image.  Note  that,  in  this  instance,  the  smoothing 
simply  obviates  false  edges  that  occur  along  partition 
boundaries;  it  does  not  visually  smooth  since  the  thresholded 
image  may  be  black  and  white. 

(6)  Alternates: 

(a)  Minimum  Error  Thresholding 

(b)  Variable  Thresholding 

(7)  References: 

Rosenfeld,  pp .  258-269. 

Pavlidis,  p.  66. 

Serra,  pp .  433-457. 


* 


A 
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APPENDIX  E 

A  BRIEF  DISCUSSION  G7  MANY  SORTED  ALGEBRA 


A  many  sorted  algebra  is  a  very  general  algebraic  structure. 
It  is  a  generalization  of  a  Universal  Algebra  and,  consequently, 
it  is  a  super  structure  for  groups,  rings,  integral  domains, 
lattices,  and  all  other  structures  definable  within  the  Universal 
Algebra  framework.  In  short,  a  Universal  Algebra  consists  of 
three  ingredients.  The  first  is  a  single  non-empty  set  of 
elements;  the  second  is  various  operators  which  map  elements  from 
these  sets  into  other  elements  in  this  set,  and  the  last  is  a 
collection  of  side  conditions  or  equational  constraints,  such  as 
the  commutative,  associative,  or  distributive  laws,  which  the 
operators  obey.  In  a  many-sorted  algebra,  more  than  one  type  of 
set  of  elements  is  allowed.  The  operators  in  this  type  of 
algebra  map  elements  from  numerous  sorts  of  sets  into  an  element 
in  some  sort  of  set.  A  variety  specification  is  also  allowed, 
using  equational  constraints. 

A  most  elegant  and  basic  example  of  a  many-sorted  algebra  is 
a  vector  space.  Here,  there  are  two  sorts  of  sets,  namely, 
vectors  and  scalars.  Numerous  operators,  such  as  vector  addition 
and  multiplication  of  a  vector  by  a  scalar,  are  among  the 
operators  in  this  algebra.  Furthermore,  various  side  conditions 
such  as  the  commutative  law  for  addition  and  various  distributive 
laws  are  well-known  for  a  vector  space  structure. 

The  application  at  hand,  namely  the  imaging  algebra  being 
proposed,  is  a  special  type  of  many  sorted  algebra.  Among  the 
sort  of  sets  involved  are  images,  reals,  and  integers.  The 
operators  for  this  algebra  involve  the  basis  operations  discussed 
in  paragraph  2  and  are  described  herein.  The  side  conditions 
that  the  operations  obey  follow  in  a  natural  manner,  since  all 
operators  are  range  or  domain  induced.  However,  this  listing 
will  be  given  as  part  of  the  Phase  II  effort. 
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APPENDIX  r 


4  SCHEDULE  Or  PHASE  II  DEVELOPMENT  TASKS 

***** 

*  TENTATIVE  SCHEDULE  OF  PHASE  II  MILESTONES 

Sep  Dec  Mar  Jun  Sep  Dec  Mar  Jun 
85  05  86  86  86  86  87  87 

Extend  Properties/ 

Relationships 

(S.O.W.  4.2.1)  _L_ _ L 

Identify  Principal 
Properties 

(S.O.W.  4.2.2)  1 _ L 

Consolidate  Theorems/ 

Proofs  (S.O.W.r.2.3)  J _ 

Advantages/ 

Disadvantages 

(S.O.W.  4.2.4)  J _ L 

A1  Feasability  Report 

(S.O.W.  4.2.5)  J _ L 

Demonstration  of 

*  Algebra  Capabilities 

(S.O.W.  4.2.6)  J _ L 

Justification  of 
Structure 

(S.O.W.  4.2.7)  J _ 
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